[ 524.333016] env[65012]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 524.333016] env[65012]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 525.419756] env[65102]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 525.419756] env[65102]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 527.255244] env[65102]: INFO neutron.common.config [-] Logging enabled! [ 527.255807] env[65102]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev51 [ 527.255807] env[65102]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65102) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 527.256194] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 527.256326] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 527.257360] env[65102]: WARNING oslo_policy.policy [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 527.257637] env[65102]: WARNING oslo_policy.policy [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 527.259512] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] VMware NSXv3 Agent initialized successfully. [ 527.260020] env[65102]: DEBUG oslo_concurrency.lockutils [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] Acquiring lock "singleton_lock" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.260184] env[65102]: DEBUG oslo_concurrency.lockutils [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] Acquired lock "singleton_lock" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.260474] env[65102]: DEBUG oslo_concurrency.lockutils [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] Releasing lock "singleton_lock" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.260915] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] Full set of CONF: {{(pid=65102) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 527.261039] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ******************************************************************************** {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 527.261147] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] Configuration options gathered from: {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 527.262023] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 527.262211] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 527.262311] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ================================================================================ {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 527.262487] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] agent_down_time = 75 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.262629] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] allow_automatic_dhcp_failover = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.262767] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] allow_bulk = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.262929] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] api_extensions_path = {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.263108] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] api_paste_config = api-paste.ini {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.263269] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] auth_strategy = keystone {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.263376] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] backdoor_port = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.263484] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] backdoor_socket = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.263619] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] backlog = 4096 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.263757] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.263919] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] bind_host = 0.0.0.0 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.264073] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] bind_port = 9696 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.264212] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] client_socket_timeout = 900 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.264350] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] config_dir = [] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.264478] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.264638] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] config_source = [] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.264900] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] control_exchange = neutron {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.265120] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] core_plugin = ml2 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.265120] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] debug = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.265285] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] default_availability_zones = [] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.265414] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.265612] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] dhcp_agent_notification = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.265755] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] dhcp_agents_per_network = 1 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.265911] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] dhcp_lease_duration = 86400 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.266091] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] dhcp_load_type = networks {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.266268] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] dns_domain = openstacklocal {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.266425] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.266634] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] enable_default_route_bfd = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.266781] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] enable_default_route_ecmp = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.266948] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] enable_dvr = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.267110] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] enable_new_agents = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.267258] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.267445] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] enable_signals = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.267675] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] enable_traditional_dhcp = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.267905] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] external_dns_driver = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.268143] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] filter_validation = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.268368] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] global_physnet_mtu = 8950 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.268583] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] graceful_shutdown_timeout = 60 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.268880] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] host = cpu-1 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.269114] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] host_dvr_for_dhcp = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.269325] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] http_retries = 3 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.269540] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] instance_format = [instance: %(uuid)s] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.269783] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.270021] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ipam_driver = internal {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.270245] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ipv6_pd_enabled = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.270464] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] l3_ha = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.270745] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.270993] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] l3_ha_network_physical_name = {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.271238] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] l3_ha_network_type = {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.271490] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] log_color = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.271722] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] log_config_append = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.271958] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.272208] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] log_dir = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.272435] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] log_file = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.272616] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] log_options = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.272851] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] log_rotate_interval = 1 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.273099] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] log_rotate_interval_type = days {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.273346] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] log_rotation_type = none {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.273523] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.273710] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.273955] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.274205] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.274392] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.274618] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] max_dns_nameservers = 5 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.274855] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] max_header_line = 16384 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.275091] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] max_l3_agents_per_router = 3 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.275321] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] max_logfile_count = 30 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.275553] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] max_logfile_size_mb = 200 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.275778] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] max_subnet_host_routes = 20 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.276031] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] my_ip = 10.180.1.21 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.276267] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] my_ipv6 = ::1 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.276499] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] network_auto_schedule = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.276721] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] network_link_prefix = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.276964] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.277231] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] notify_nova_on_port_data_changes = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.277472] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] notify_nova_on_port_status_changes = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.277703] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] pagination_max_limit = -1 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.277935] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] publish_errors = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.278140] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] rate_limit_burst = 0 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.278347] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] rate_limit_except_level = CRITICAL {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.278543] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] rate_limit_interval = 0 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.278696] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] retry_until_window = 30 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.278833] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] router_distributed = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.278970] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] rpc_resources_processing_step = 20 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.279121] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] rpc_response_max_timeout = 600 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.279260] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] rpc_response_timeout = 60 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.279394] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] send_events_interval = 2 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.279550] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] service_plugins = ['router'] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.279697] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] setproctitle = on {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.279830] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] shell_completion = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.279966] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] state_path = /opt/stack/data/neutron {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.280118] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] syslog_log_facility = LOG_USER {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.280253] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] tcp_keepidle = 600 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.280393] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] transport_url = **** {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.280526] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] use_journal = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.280658] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] use_json = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.280812] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] use_ssl = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.281019] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] use_stderr = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.281225] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] use_syslog = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.281439] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] vlan_qinq = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.281653] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] vlan_transparent = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.281799] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] watch_log_file = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.281939] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] wsgi_default_pool_size = 100 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.282090] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] wsgi_keep_alive = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.282234] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.282372] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] wsgi_server_debug = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.282526] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_concurrency.disable_process_locking = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.282678] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.282819] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.282958] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.283118] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.283262] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.283398] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.283553] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] profiler.connection_string = messaging:// {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.283699] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] profiler.enabled = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.283843] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] profiler.es_doc_type = notification {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.283980] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] profiler.es_scroll_size = 10000 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.284130] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] profiler.es_scroll_time = 2m {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.284270] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] profiler.filter_error_trace = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.284412] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] profiler.hmac_keys = **** {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.284551] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] profiler.sentinel_service_name = mymaster {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.284698] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] profiler.socket_timeout = 0.1 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.284830] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] profiler.trace_requests = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.284960] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] profiler.trace_sqlalchemy = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.285223] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] profiler_jaeger.process_tags = {} {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.285289] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] profiler_jaeger.service_name_prefix = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.285388] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] profiler_otlp.service_name_prefix = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.285591] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_policy.enforce_new_defaults = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.285882] env[65102]: WARNING oslo_config.cfg [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 527.286047] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_policy.enforce_scope = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.286199] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_policy.policy_default_rule = default {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.286362] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.286602] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.286855] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.287084] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.287300] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.287545] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.287756] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.287978] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.288232] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.288513] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] agent.extensions = [] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.288691] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.288906] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] service_providers.service_provider = [] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.289144] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] QUOTAS.default_quota = -1 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.289370] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.289585] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] QUOTAS.quota_floatingip = 50 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.289804] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] QUOTAS.quota_network = 100 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.290111] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] QUOTAS.quota_port = 500 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.290349] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.290572] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] QUOTAS.quota_router = 10 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.290784] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] QUOTAS.quota_security_group = 10 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.291028] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.291248] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] QUOTAS.quota_subnet = 100 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.291460] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] QUOTAS.track_quota_usage = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.291690] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.291907] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep.group = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.292139] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep.helper_command = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.292358] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep.log_daemon_traceback = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.292576] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.292792] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep.thread_pool_size = 8 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.293017] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep.user = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.293249] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.293463] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_dhcp_release.group = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.293661] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_dhcp_release.helper_command = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.293987] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.294246] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.294459] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.294674] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_dhcp_release.user = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.294912] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.295133] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_ovs_vsctl.group = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.295361] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.295562] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.295788] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.296010] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.296234] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_ovs_vsctl.user = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.296451] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_namespace.capabilities = [21] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.296654] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_namespace.group = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.296855] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_namespace.helper_command = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.297094] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.297312] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.297507] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.297692] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_namespace.user = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.297905] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_conntrack.capabilities = [12] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.298131] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_conntrack.group = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.298354] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_conntrack.helper_command = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.298567] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.298733] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.298924] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.299127] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_conntrack.user = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.299282] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_link.capabilities = [12, 21] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.299417] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_link.group = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.299548] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_link.helper_command = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.299687] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_link.log_daemon_traceback = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.299826] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.299959] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_link.thread_pool_size = 8 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.300100] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] privsep_link.user = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.300257] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.300406] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.300546] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.continue_on_failed_promotions = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.300682] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.dscp = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.300820] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.dscp_inherit = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.300964] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.force_mp_to_policy = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.301132] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.locking_coordinator_url = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.301274] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.log_agent_heartbeats = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.301410] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.logging_expire = 1 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.301554] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.301692] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.301837] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.polling_interval = 240 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.301972] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.302128] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.302273] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.report_interval = 30.0 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.302419] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.302557] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.302699] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.302838] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.sync_skew = 60 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.303030] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.synchronization_queue_size = 20 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.303276] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT.use_helper_for_ns_read = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.303528] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] SECURITYGROUP.enable_ipset = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.303702] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] SECURITYGROUP.enable_security_group = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.303856] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.304012] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.304165] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] experimental.ipv6_pd_enabled = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.304329] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ml2.extension_drivers = ['port_security'] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.304463] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ml2.external_network_type = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.304617] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.304764] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ml2.overlay_ip_version = 4 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.304908] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ml2.path_mtu = 8950 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.305065] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ml2.physical_network_mtus = {} {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.305217] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.305361] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.305635] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ml2.type_drivers = ['vlan'] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.305777] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.305954] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.306185] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.306411] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.306634] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.306839] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.307061] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.307276] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.307478] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.307794] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.308031] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_login_password = **** {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.308228] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.308385] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_login_user = admin {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.308533] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.308683] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.308821] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.308958] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.309120] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.309264] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.309405] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.309544] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.309682] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.309828] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.309971] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.310118] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.310261] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.310461] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.310608] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.310750] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.310884] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.311034] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] nova.auth_section = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.311185] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] nova.auth_type = password {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.311327] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.311460] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] nova.certfile = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.311600] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] nova.collect_timing = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.311747] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] nova.endpoint_type = public {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.311885] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] nova.insecure = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.312027] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] nova.keyfile = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.312169] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] nova.region_name = RegionOne {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.312307] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] nova.split_loggers = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.312440] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] nova.timeout = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.312580] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] placement.auth_section = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.312725] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] placement.auth_type = password {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.312863] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.313057] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] placement.certfile = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.313224] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] placement.collect_timing = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.313369] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] placement.endpoint_type = public {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.313506] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] placement.insecure = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.313745] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] placement.keyfile = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.313879] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] placement.region_name = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.314026] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] placement.split_loggers = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.314161] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] placement.timeout = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.314298] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.auth_section = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.314432] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.auth_type = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.314565] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.cafile = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.314699] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.certfile = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.314836] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.collect_timing = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.314967] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.connect_retries = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.315110] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.connect_retry_delay = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.315245] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.enable_notifications = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.315374] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.endpoint_override = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.315530] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.insecure = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.315690] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.interface = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.315804] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.keyfile = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.315939] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.max_version = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.316083] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.min_version = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.316216] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.region_name = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.316346] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.retriable_status_codes = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.316490] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.service_name = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.316636] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.service_type = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.316779] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.split_loggers = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.316910] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.status_code_retries = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.317050] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.status_code_retry_delay = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.317184] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.timeout = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.317312] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.valid_interfaces = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.317442] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ironic.version = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.317582] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] cli_script.dry_run = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.317729] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.317864] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.317999] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.318147] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.318280] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.318411] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.318542] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.318677] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.318807] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.318951] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.319095] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.319238] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.319379] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.319518] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.319654] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.319795] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.319930] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.320073] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.320216] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.320352] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.320484] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.320619] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.320751] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.320884] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.321029] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.321167] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.321304] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.321436] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.321569] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.321703] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.321836] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.ssl = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.321975] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.322129] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.322264] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.322401] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.322537] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.322671] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.322815] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_notifications.driver = [] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.322952] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_notifications.retry = -1 {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.323113] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.323248] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.323353] env[65102]: DEBUG oslo_service.backend._eventlet.service [None req-49e27575-9f9d-46dc-92e4-fc4b0f3483b5 None None] ******************************************************************************** {{(pid=65102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 527.324499] env[65102]: DEBUG neutron.agent.securitygroups_rpc [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Init firewall settings (driver=nsxv3) {{(pid=65102) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 527.325822] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65102) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 527.326073] env[65102]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] RPC agent_id: nsxm-l-01a.corp.local [ 527.328294] env[65102]: DEBUG dogpile.cache.region [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 527.328424] env[65102]: DEBUG dogpile.lock [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 527.328546] env[65102]: DEBUG dogpile.lock [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 527.328607] env[65102]: DEBUG dogpile.lock [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 527.328697] env[65102]: DEBUG dogpile.cache.region [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 527.328918] env[65102]: DEBUG dogpile.lock [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 527.329024] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 527.361419] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Session token - acquiring [ 527.362931] env[65102]: DEBUG networking_nsxv3.common.locking [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.363155] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.363220] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.363689] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.374031] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.652140] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 527.673368] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 527.673567] env[65102]: DEBUG dogpile.cache.region [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Cache value generated in 0.344 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 527.673656] env[65102]: DEBUG dogpile.lock [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 527.673782] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Activating Policy API Provider. [ 527.673985] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Looking for the default Infrastructure Rules. [ 527.734959] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Looking for the Default Layer3 Logged Drop Section. [ 527.749642] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 527.750119] env[65102]: DEBUG networking_nsxv3.common.locking [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.750298] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquiring lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.750402] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.750712] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired external semaphore "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.751064] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 528.265728] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 528.768277] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.270344] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Inventory metadata is going to be refreshed. [ 529.270828] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 530.028191] env[65102]: DEBUG networking_nsxv3.common.locking [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.028544] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.028670] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.028999] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.040625] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 530.041555] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.042413] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 530.060662] env[65102]: DEBUG networking_nsxv3.common.locking [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.060959] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.060959] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.061265] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.061393] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.061545] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 530.061661] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.061766] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 530.081089] env[65102]: DEBUG networking_nsxv3.common.locking [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.081368] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.081368] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.081638] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.081857] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.082015] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 530.104917] env[65102]: DEBUG networking_nsxv3.common.locking [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.105354] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.105354] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.105738] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.105961] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.106195] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 530.126810] env[65102]: DEBUG networking_nsxv3.common.locking [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.127083] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquiring lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.127083] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.127374] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired external semaphore "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.127545] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Releasing lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.127695] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 530.127799] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.127901] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 530.146281] env[65102]: DEBUG networking_nsxv3.common.locking [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.146281] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquiring lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.146281] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.146707] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired external semaphore "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.146707] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Releasing lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.146858] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 530.146962] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.147079] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 530.165758] env[65102]: DEBUG networking_nsxv3.common.locking [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.166065] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.166065] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.166425] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.166794] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.166978] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 530.167136] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.167258] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Inventory metadata have been refreshed. [ 530.167402] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Dryrun:True. Metadata refresh completed. [ 530.167587] env[65102]: DEBUG oslo_concurrency.lockutils [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Releasing lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.169693] env[65102]: INFO neutron.agent.agent_extensions_manager [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Loaded agent extensions: [] [ 530.170533] env[65102]: DEBUG neutron_lib.callbacks.manager [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65102) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 530.250308] env[65102]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] NSXv3 Agent Agent RPC Daemon Started! [ 530.250484] env[65102]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] NSXv3 Agent Agent loop - iteration:0 started [ 530.250612] env[65102]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] NSXv3 Agent Agent out of sync with plugin! [ 535.171398] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 535.171398] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 540.172210] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 540.172567] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 545.174247] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 545.174247] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 545.327600] env[65102]: INFO networking_nsxv3.common.synchronization [None req-f4757fad-9b5a-4898-93d4-14c7ec13999a demo admin] Enqueued Resource ID: 0ae5fe8d-9309-44eb-a840-ce2bd18a1dae with Priority: HIGHEST for action security_group_rules [ 545.328151] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae5fe8d-9309-44eb-a840-ce2bd18a1dae with Priority: HIGHEST for action security_group_rules [ 545.328461] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ae5fe8d-9309-44eb-a840-ce2bd18a1dae taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.328586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ae5fe8d-9309-44eb-a840-ce2bd18a1dae" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.328654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ae5fe8d-9309-44eb-a840-ce2bd18a1dae" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.328994] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ae5fe8d-9309-44eb-a840-ce2bd18a1dae" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.329094] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ae5fe8d-9309-44eb-a840-ce2bd18a1dae',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 545.849931] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.850190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.850190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.850355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.850446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.850540] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ae5fe8d-9309-44eb-a840-ce2bd18a1dae already deleted. [ 545.850624] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ae5fe8d-9309-44eb-a840-ce2bd18a1dae" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.329653] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 550.329653] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 555.330749] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 555.330749] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 560.331643] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.332118] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 565.332661] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 565.333064] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.334882] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 570.335232] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.436846] env[65102]: INFO networking_nsxv3.common.synchronization [None req-7d8f571a-29cf-498d-a87f-46c454d199eb None None] Enqueued Resource ID: 4af0e7d5-4a78-43a4-8ae5-71cc45bfb888 with Priority: HIGHEST for action port [ 570.438123] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4af0e7d5-4a78-43a4-8ae5-71cc45bfb888 with Priority: HIGHEST for action port [ 570.438123] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-4af0e7d5-4a78-43a4-8ae5-71cc45bfb888 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.438123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4af0e7d5-4a78-43a4-8ae5-71cc45bfb888" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.438123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4af0e7d5-4a78-43a4-8ae5-71cc45bfb888" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.439753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4af0e7d5-4a78-43a4-8ae5-71cc45bfb888" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.439753] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4af0e7d5-4a78-43a4-8ae5-71cc45bfb888',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.942957] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4af0e7d5-4a78-43a4-8ae5-71cc45bfb888 [ 570.943154] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.943313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.943410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.943628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.943719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.943816] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4af0e7d5-4a78-43a4-8ae5-71cc45bfb888 already deleted. [ 570.943898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4af0e7d5-4a78-43a4-8ae5-71cc45bfb888" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.205491] env[65102]: INFO networking_nsxv3.common.synchronization [None req-4602b325-3033-4ed6-8b0a-a03041b0c87e None None] Enqueued Resource ID: 2e44316c-bb38-4bd4-b1fa-2444f1642d4e with Priority: HIGHEST for action port [ 572.206175] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e44316c-bb38-4bd4-b1fa-2444f1642d4e with Priority: HIGHEST for action port [ 572.206512] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e44316c-bb38-4bd4-b1fa-2444f1642d4e taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.206721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e44316c-bb38-4bd4-b1fa-2444f1642d4e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.206721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e44316c-bb38-4bd4-b1fa-2444f1642d4e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.206979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e44316c-bb38-4bd4-b1fa-2444f1642d4e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.207420] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e44316c-bb38-4bd4-b1fa-2444f1642d4e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.709376] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e44316c-bb38-4bd4-b1fa-2444f1642d4e [ 572.709615] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.709744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.709814] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.710047] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.710142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.710242] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e44316c-bb38-4bd4-b1fa-2444f1642d4e already deleted. [ 572.710328] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e44316c-bb38-4bd4-b1fa-2444f1642d4e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.960938] env[65102]: INFO networking_nsxv3.common.synchronization [None req-f696922c-d36d-4ae5-a1d4-292ba539ab5e None None] Enqueued Resource ID: b9c57610-8231-432b-a024-32cea0c98bd2 with Priority: HIGHEST for action port [ 573.961735] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9c57610-8231-432b-a024-32cea0c98bd2 with Priority: HIGHEST for action port [ 573.961977] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9c57610-8231-432b-a024-32cea0c98bd2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.961977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9c57610-8231-432b-a024-32cea0c98bd2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.961977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9c57610-8231-432b-a024-32cea0c98bd2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.962275] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9c57610-8231-432b-a024-32cea0c98bd2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.962275] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9c57610-8231-432b-a024-32cea0c98bd2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.175435] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.175435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.175435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.175435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.175435] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.464233] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9c57610-8231-432b-a024-32cea0c98bd2 [ 574.464347] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.464655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.464655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.465012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.465012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.465104] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9c57610-8231-432b-a024-32cea0c98bd2 already deleted. [ 574.465138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9c57610-8231-432b-a024-32cea0c98bd2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.676963] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.180645] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.682946] env[65102]: INFO networking_nsxv3.common.synchronization [None req-49d55159-10cd-479e-b02b-cdec8ac911a4 None None] Enqueued Resource ID: 298a8aac-8059-40dc-a571-561eca186978 with Priority: HIGHEST for action port [ 575.683198] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 575.683234] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 575.684979] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 298a8aac-8059-40dc-a571-561eca186978 with Priority: HIGHEST for action port [ 575.684979] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-298a8aac-8059-40dc-a571-561eca186978 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.685106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-298a8aac-8059-40dc-a571-561eca186978" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.685177] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-298a8aac-8059-40dc-a571-561eca186978" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.685928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-298a8aac-8059-40dc-a571-561eca186978" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.685928] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('298a8aac-8059-40dc-a571-561eca186978',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.191110] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 298a8aac-8059-40dc-a571-561eca186978 [ 576.191759] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.192188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.192357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.192651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.192828] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.193702] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:298a8aac-8059-40dc-a571-561eca186978 already deleted. [ 576.197288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-298a8aac-8059-40dc-a571-561eca186978" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.329059] env[65102]: INFO networking_nsxv3.common.synchronization [None req-fb80b47b-7f6a-41ac-a027-beca02c0400b None None] Enqueued Resource ID: 08363fb1-cb29-4371-9f41-de1a6f92c43d with Priority: HIGHEST for action port [ 576.329197] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08363fb1-cb29-4371-9f41-de1a6f92c43d with Priority: HIGHEST for action port [ 576.330346] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-08363fb1-cb29-4371-9f41-de1a6f92c43d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.330346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08363fb1-cb29-4371-9f41-de1a6f92c43d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.330346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08363fb1-cb29-4371-9f41-de1a6f92c43d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.331565] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08363fb1-cb29-4371-9f41-de1a6f92c43d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.331670] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08363fb1-cb29-4371-9f41-de1a6f92c43d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.487839] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.487989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.488112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.488345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.505753] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 576.506610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.507830] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 576.530110] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.530338] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.530338] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.530524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.530612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.530724] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 576.530795] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.530904] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 576.554161] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.554572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.554572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.554719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.554826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.555026] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 576.582466] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.582683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.582683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.583141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.583141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.583141] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 576.610179] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.610826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.610826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.610826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.610826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.610826] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 576.610826] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.611537] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 576.632880] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.632880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.632880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.632880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.632880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.633383] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 576.633383] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.633383] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 576.669930] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.670090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.670171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.670392] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.670505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.670614] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 576.671152] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 576.671290] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 576.671374] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 576.671457] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 576.671519] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 576.671584] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 576.671972] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 576.672303] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 576.672417] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 576.697258] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.697258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.697437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.697566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.697642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.697782] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 576.719704] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.720866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.720866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.721020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.721981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.738141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.837625] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08363fb1-cb29-4371-9f41-de1a6f92c43d [ 576.837625] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.837625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.837625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.837625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.837625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.837625] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08363fb1-cb29-4371-9f41-de1a6f92c43d already deleted. [ 576.837625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08363fb1-cb29-4371-9f41-de1a6f92c43d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.125130] env[65102]: INFO networking_nsxv3.common.synchronization [None req-7fea5241-cffb-496a-a5ab-0ac609513b1a None None] Enqueued Resource ID: 8bff569c-c107-4aaa-9d5c-c41f5e1d8af1 with Priority: HIGHEST for action port [ 577.125423] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bff569c-c107-4aaa-9d5c-c41f5e1d8af1 with Priority: HIGHEST for action port [ 577.125730] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bff569c-c107-4aaa-9d5c-c41f5e1d8af1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.125867] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bff569c-c107-4aaa-9d5c-c41f5e1d8af1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.125967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bff569c-c107-4aaa-9d5c-c41f5e1d8af1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.126283] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bff569c-c107-4aaa-9d5c-c41f5e1d8af1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.126565] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bff569c-c107-4aaa-9d5c-c41f5e1d8af1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.630023] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8bff569c-c107-4aaa-9d5c-c41f5e1d8af1 [ 577.630292] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.630410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.630479] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.630694] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.631526] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.631526] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8bff569c-c107-4aaa-9d5c-c41f5e1d8af1 already deleted. [ 577.631526] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bff569c-c107-4aaa-9d5c-c41f5e1d8af1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.797719] env[65102]: INFO networking_nsxv3.common.synchronization [None req-13841780-113e-4d5b-8880-dd701768cdd9 None None] Enqueued Resource ID: 123545f7-a6da-414d-8c10-3e2cefd48b6f with Priority: HIGHEST for action port [ 578.798022] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 123545f7-a6da-414d-8c10-3e2cefd48b6f with Priority: HIGHEST for action port [ 578.798665] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-123545f7-a6da-414d-8c10-3e2cefd48b6f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.801373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-123545f7-a6da-414d-8c10-3e2cefd48b6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.801373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-123545f7-a6da-414d-8c10-3e2cefd48b6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.801373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-123545f7-a6da-414d-8c10-3e2cefd48b6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.801373] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('123545f7-a6da-414d-8c10-3e2cefd48b6f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.302346] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 123545f7-a6da-414d-8c10-3e2cefd48b6f [ 579.304420] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.304420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.304420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.304420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.304420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.304420] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:123545f7-a6da-414d-8c10-3e2cefd48b6f already deleted. [ 579.304420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-123545f7-a6da-414d-8c10-3e2cefd48b6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.838149] env[65102]: INFO networking_nsxv3.common.synchronization [None req-963f83bc-436a-4bf1-aa62-74085a7dc241 None None] Enqueued Resource ID: d7ecb860-2c9a-4edd-bdd8-a9ea6c5a75fe with Priority: HIGHEST for action port [ 579.839021] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7ecb860-2c9a-4edd-bdd8-a9ea6c5a75fe with Priority: HIGHEST for action port [ 579.839021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7ecb860-2c9a-4edd-bdd8-a9ea6c5a75fe taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.839214] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7ecb860-2c9a-4edd-bdd8-a9ea6c5a75fe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.839304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7ecb860-2c9a-4edd-bdd8-a9ea6c5a75fe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.840011] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7ecb860-2c9a-4edd-bdd8-a9ea6c5a75fe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.840011] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7ecb860-2c9a-4edd-bdd8-a9ea6c5a75fe',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.141366] env[65102]: INFO networking_nsxv3.common.synchronization [None req-b2637f71-e619-4a1f-a09f-4538c1ae29cb None None] Enqueued Resource ID: ea472f19-a0ad-448e-88b4-8adb4c34bdce with Priority: HIGHEST for action port [ 580.141430] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea472f19-a0ad-448e-88b4-8adb4c34bdce with Priority: HIGHEST for action port [ 580.143361] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea472f19-a0ad-448e-88b4-8adb4c34bdce taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.143529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea472f19-a0ad-448e-88b4-8adb4c34bdce" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.143603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea472f19-a0ad-448e-88b4-8adb4c34bdce" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.144014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea472f19-a0ad-448e-88b4-8adb4c34bdce" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.144103] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea472f19-a0ad-448e-88b4-8adb4c34bdce',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.345232] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7ecb860-2c9a-4edd-bdd8-a9ea6c5a75fe [ 580.345719] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.347117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.347376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.348387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.348387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.348387] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7ecb860-2c9a-4edd-bdd8-a9ea6c5a75fe already deleted. [ 580.348387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7ecb860-2c9a-4edd-bdd8-a9ea6c5a75fe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.646641] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea472f19-a0ad-448e-88b4-8adb4c34bdce [ 580.646793] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.646934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.647009] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.647292] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.647404] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.647528] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea472f19-a0ad-448e-88b4-8adb4c34bdce already deleted. [ 580.647606] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea472f19-a0ad-448e-88b4-8adb4c34bdce" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.981495] env[65102]: INFO networking_nsxv3.common.synchronization [None req-bee07283-e36f-4159-88a5-172953042422 None None] Enqueued Resource ID: 473a5c92-e230-4eec-918b-272e5c0ff043 with Priority: HIGHEST for action port [ 581.981495] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473a5c92-e230-4eec-918b-272e5c0ff043 with Priority: HIGHEST for action port [ 581.981495] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-473a5c92-e230-4eec-918b-272e5c0ff043 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.981495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-473a5c92-e230-4eec-918b-272e5c0ff043" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.982118] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-473a5c92-e230-4eec-918b-272e5c0ff043" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.982118] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-473a5c92-e230-4eec-918b-272e5c0ff043" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.982191] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('473a5c92-e230-4eec-918b-272e5c0ff043',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.132606] env[65102]: INFO networking_nsxv3.common.synchronization [None req-1373d31f-9910-4f3c-8cb5-152bd7c37042 None None] Enqueued Resource ID: 5c51d15d-6edf-4476-8a7b-190fe1a272b2 with Priority: HIGHEST for action port [ 582.133155] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c51d15d-6edf-4476-8a7b-190fe1a272b2 with Priority: HIGHEST for action port [ 582.133484] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c51d15d-6edf-4476-8a7b-190fe1a272b2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.133614] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c51d15d-6edf-4476-8a7b-190fe1a272b2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.133683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c51d15d-6edf-4476-8a7b-190fe1a272b2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.133928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c51d15d-6edf-4476-8a7b-190fe1a272b2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.134016] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c51d15d-6edf-4476-8a7b-190fe1a272b2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.486727] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 473a5c92-e230-4eec-918b-272e5c0ff043 [ 582.486727] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.486727] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.486727] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.486727] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.486727] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.486727] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:473a5c92-e230-4eec-918b-272e5c0ff043 already deleted. [ 582.486727] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-473a5c92-e230-4eec-918b-272e5c0ff043" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.642097] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c51d15d-6edf-4476-8a7b-190fe1a272b2 [ 582.642447] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.642567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.642567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.642787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.643032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.643032] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c51d15d-6edf-4476-8a7b-190fe1a272b2 already deleted. [ 582.643275] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c51d15d-6edf-4476-8a7b-190fe1a272b2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.160901] env[65102]: INFO networking_nsxv3.common.synchronization [None req-da065939-fb16-461f-a852-6c8966328edf None None] Enqueued Resource ID: b4618318-9c45-4d31-8108-f15abe465b36 with Priority: HIGHEST for action port [ 584.161927] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4618318-9c45-4d31-8108-f15abe465b36 with Priority: HIGHEST for action port [ 584.161927] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4618318-9c45-4d31-8108-f15abe465b36 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.161927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4618318-9c45-4d31-8108-f15abe465b36" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.161927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4618318-9c45-4d31-8108-f15abe465b36" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.162210] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4618318-9c45-4d31-8108-f15abe465b36" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.162297] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4618318-9c45-4d31-8108-f15abe465b36',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.411869] env[65102]: INFO networking_nsxv3.common.synchronization [None req-c8df8242-b9cb-4a62-bfd9-2836aff83882 None None] Enqueued Resource ID: 0546193d-68d6-428e-81fe-1d153eb8dbd8 with Priority: HIGHEST for action port [ 584.412427] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0546193d-68d6-428e-81fe-1d153eb8dbd8 with Priority: HIGHEST for action port [ 584.412750] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-0546193d-68d6-428e-81fe-1d153eb8dbd8 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.412937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0546193d-68d6-428e-81fe-1d153eb8dbd8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.412937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0546193d-68d6-428e-81fe-1d153eb8dbd8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.413373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0546193d-68d6-428e-81fe-1d153eb8dbd8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.413488] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0546193d-68d6-428e-81fe-1d153eb8dbd8',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.664880] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4618318-9c45-4d31-8108-f15abe465b36 [ 584.665117] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.665262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.665320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.666378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.666378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.666378] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4618318-9c45-4d31-8108-f15abe465b36 already deleted. [ 584.666378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4618318-9c45-4d31-8108-f15abe465b36" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.755525] env[65102]: INFO networking_nsxv3.common.synchronization [None req-9e6b60b2-7365-41e9-b895-5aea15b962ff None None] Enqueued Resource ID: fff98e2d-d012-4cfb-a791-d93f0222016c with Priority: HIGHEST for action port [ 584.756059] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff98e2d-d012-4cfb-a791-d93f0222016c with Priority: HIGHEST for action port [ 584.756374] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-fff98e2d-d012-4cfb-a791-d93f0222016c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.756654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fff98e2d-d012-4cfb-a791-d93f0222016c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.756654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fff98e2d-d012-4cfb-a791-d93f0222016c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.756794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fff98e2d-d012-4cfb-a791-d93f0222016c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.756881] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fff98e2d-d012-4cfb-a791-d93f0222016c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.917829] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0546193d-68d6-428e-81fe-1d153eb8dbd8 [ 584.918075] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.918204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.918271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.918467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.918551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.918639] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0546193d-68d6-428e-81fe-1d153eb8dbd8 already deleted. [ 584.918715] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0546193d-68d6-428e-81fe-1d153eb8dbd8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.259770] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fff98e2d-d012-4cfb-a791-d93f0222016c [ 585.259770] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.259770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.259770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.259770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.259770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.259770] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fff98e2d-d012-4cfb-a791-d93f0222016c already deleted. [ 585.259770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fff98e2d-d012-4cfb-a791-d93f0222016c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.481921] env[65102]: INFO networking_nsxv3.common.synchronization [None req-fd9dc073-c69e-4ec4-9b49-d7200cf2945c None None] Enqueued Resource ID: d8fbf4d5-295c-48ee-8b2f-30a1d11a639e with Priority: HIGHEST for action port [ 586.482241] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8fbf4d5-295c-48ee-8b2f-30a1d11a639e with Priority: HIGHEST for action port [ 586.482715] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8fbf4d5-295c-48ee-8b2f-30a1d11a639e taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.482824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8fbf4d5-295c-48ee-8b2f-30a1d11a639e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.482824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8fbf4d5-295c-48ee-8b2f-30a1d11a639e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.483860] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8fbf4d5-295c-48ee-8b2f-30a1d11a639e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.483860] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8fbf4d5-295c-48ee-8b2f-30a1d11a639e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.716283] env[65102]: INFO networking_nsxv3.common.synchronization [None req-9d4470aa-98a3-45f6-82c2-7351a4a14416 None None] Enqueued Resource ID: 1f44bb79-f266-4184-b336-9cd469078c6f with Priority: HIGHEST for action port [ 586.717328] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f44bb79-f266-4184-b336-9cd469078c6f with Priority: HIGHEST for action port [ 586.717506] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f44bb79-f266-4184-b336-9cd469078c6f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.717692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f44bb79-f266-4184-b336-9cd469078c6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.717764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f44bb79-f266-4184-b336-9cd469078c6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.718044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f44bb79-f266-4184-b336-9cd469078c6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.718166] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f44bb79-f266-4184-b336-9cd469078c6f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.987906] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8fbf4d5-295c-48ee-8b2f-30a1d11a639e [ 586.988221] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.988318] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.988356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.988690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.988690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.988763] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8fbf4d5-295c-48ee-8b2f-30a1d11a639e already deleted. [ 586.988841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8fbf4d5-295c-48ee-8b2f-30a1d11a639e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.220996] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f44bb79-f266-4184-b336-9cd469078c6f [ 587.221149] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.221280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.221347] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.221561] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.221641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.221738] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f44bb79-f266-4184-b336-9cd469078c6f already deleted. [ 587.221820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f44bb79-f266-4184-b336-9cd469078c6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.206290] env[65102]: INFO networking_nsxv3.common.synchronization [None req-b9441bb3-bd72-4616-bd81-bb007607dbaa None None] Enqueued Resource ID: d13e4388-1f6a-4a2d-b851-40b89ca956f9 with Priority: HIGHEST for action port [ 589.207144] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d13e4388-1f6a-4a2d-b851-40b89ca956f9 with Priority: HIGHEST for action port [ 589.207144] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d13e4388-1f6a-4a2d-b851-40b89ca956f9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.207268] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d13e4388-1f6a-4a2d-b851-40b89ca956f9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.207351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d13e4388-1f6a-4a2d-b851-40b89ca956f9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.210687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d13e4388-1f6a-4a2d-b851-40b89ca956f9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.210801] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d13e4388-1f6a-4a2d-b851-40b89ca956f9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.498912] env[65102]: INFO networking_nsxv3.common.synchronization [None req-18eec2a8-48b3-41a0-9876-d99b6d740418 None None] Enqueued Resource ID: 0b7f31be-1baf-4686-951a-215189b56775 with Priority: HIGHEST for action port [ 589.499318] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b7f31be-1baf-4686-951a-215189b56775 with Priority: HIGHEST for action port [ 589.500203] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b7f31be-1baf-4686-951a-215189b56775 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.500203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b7f31be-1baf-4686-951a-215189b56775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.500203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b7f31be-1baf-4686-951a-215189b56775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.500670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b7f31be-1baf-4686-951a-215189b56775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.500670] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b7f31be-1baf-4686-951a-215189b56775',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.714690] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d13e4388-1f6a-4a2d-b851-40b89ca956f9 [ 589.714690] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.714690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.714690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.714690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.714690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.714690] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d13e4388-1f6a-4a2d-b851-40b89ca956f9 already deleted. [ 589.714690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d13e4388-1f6a-4a2d-b851-40b89ca956f9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.002343] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b7f31be-1baf-4686-951a-215189b56775 [ 590.002576] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.002709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.002777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.002983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.003161] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.003256] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b7f31be-1baf-4686-951a-215189b56775 already deleted. [ 590.003341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b7f31be-1baf-4686-951a-215189b56775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.095154] env[65102]: INFO networking_nsxv3.common.synchronization [None req-5059b8df-19f7-488f-8be6-a1a5fecc2a90 tempest-VolumesAssistedSnapshotsTest-997297769 tempest-VolumesAssistedSnapshotsTest-997297769-project-member] Enqueued Resource ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c with Priority: HIGHEST for action security_group_rules [ 590.095729] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c with Priority: HIGHEST for action security_group_rules [ 590.096088] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.096226] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.099398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.099398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.099398] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('687f9a90-8cf8-4c0f-bfe9-b1800ef9665c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.185426] env[65102]: INFO networking_nsxv3.common.synchronization [None req-b73e0c23-ae24-47c3-b6be-dbd7a7557d62 tempest-VolumesAssistedSnapshotsTest-997297769 tempest-VolumesAssistedSnapshotsTest-997297769-project-member] Enqueued Resource ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c with Priority: HIGHEST for action security_group_rules [ 590.186268] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c with Priority: HIGHEST for action security_group_rules [ 590.186783] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.186890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.621723] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.621723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.621723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.621723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.621723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.621723] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c already deleted. [ 590.621723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.622205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.622205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.622205] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('687f9a90-8cf8-4c0f-bfe9-b1800ef9665c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.143865] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.144037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.144143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.144398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.144507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.144611] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c already deleted. [ 591.144695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.961628] env[65102]: INFO networking_nsxv3.common.synchronization [req-1098d80d-3092-4763-875f-f60296eaeeb9 req-0073dbbe-5aa6-4c78-a6d4-f37a562ced47 tempest-ServersAdminTestJSON-1629823880 tempest-ServersAdminTestJSON-1629823880-project-member] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 593.962014] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 593.962157] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.962275] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.962520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.962663] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.962722] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.962820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.962880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.963858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.963858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.963858] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.044975] env[65102]: INFO networking_nsxv3.common.synchronization [None req-0ef7fb92-23bc-4e15-8de0-9a1a130d16fc None None] Enqueued Resource ID: 9966bc89-ab98-41ec-b3ae-a611838abc9b with Priority: HIGHEST for action port [ 594.045533] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9966bc89-ab98-41ec-b3ae-a611838abc9b with Priority: HIGHEST for action port [ 594.045832] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-9966bc89-ab98-41ec-b3ae-a611838abc9b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.045954] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9966bc89-ab98-41ec-b3ae-a611838abc9b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.047024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9966bc89-ab98-41ec-b3ae-a611838abc9b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.047403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9966bc89-ab98-41ec-b3ae-a611838abc9b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.047685] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9966bc89-ab98-41ec-b3ae-a611838abc9b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.053340] env[65102]: INFO networking_nsxv3.common.synchronization [None req-88b21da5-7906-4aca-af8c-34e8a9b0fb61 None None] Enqueued Resource ID: a31463e5-75aa-42e0-b769-08a314e2513a with Priority: HIGHEST for action port [ 594.054373] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a31463e5-75aa-42e0-b769-08a314e2513a with Priority: HIGHEST for action port [ 594.054373] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-a31463e5-75aa-42e0-b769-08a314e2513a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.054466] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a31463e5-75aa-42e0-b769-08a314e2513a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.054498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a31463e5-75aa-42e0-b769-08a314e2513a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.054761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a31463e5-75aa-42e0-b769-08a314e2513a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.054844] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a31463e5-75aa-42e0-b769-08a314e2513a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.465964] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.466171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.466212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.466438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.466524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.466721] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.466825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.466877] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.467040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.467123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.467211] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f already deleted. [ 594.467293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.551461] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9966bc89-ab98-41ec-b3ae-a611838abc9b [ 594.551600] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.551669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.551669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.551887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.551991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.552099] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9966bc89-ab98-41ec-b3ae-a611838abc9b already deleted. [ 594.552184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9966bc89-ab98-41ec-b3ae-a611838abc9b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.557653] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a31463e5-75aa-42e0-b769-08a314e2513a [ 594.557824] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.558194] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.558302] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.558510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.558598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.558691] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a31463e5-75aa-42e0-b769-08a314e2513a already deleted. [ 594.559082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a31463e5-75aa-42e0-b769-08a314e2513a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.223178] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-552 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.223178] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.224771] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.225536] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.225709] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.227702] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.227853] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.228133] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.228286] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.228635] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.229946] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.229946] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.229946] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.229946] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.229946] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.229946] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.253972] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.254204] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 595.254356] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.255311] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.255692] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-2686e3e0-c528-42bb-9444-050209faa6b1 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.256119] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-2686e3e0-c528-42bb-9444-050209faa6b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.256869] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-2686e3e0-c528-42bb-9444-050209faa6b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.256869] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-2686e3e0-c528-42bb-9444-050209faa6b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.256869] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2686e3e0-c528-42bb-9444-050209faa6b1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.727759] env[65102]: INFO networking_nsxv3.common.synchronization [None req-6b7e714e-7205-4610-9b8f-9caaafbfb763 None None] Enqueued Resource ID: 4f51d878-e0e5-415f-90ea-2248fcc56c35 with Priority: HIGHEST for action port [ 595.728029] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f51d878-e0e5-415f-90ea-2248fcc56c35 with Priority: HIGHEST for action port [ 595.728638] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f51d878-e0e5-415f-90ea-2248fcc56c35 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.728772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f51d878-e0e5-415f-90ea-2248fcc56c35" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.728847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f51d878-e0e5-415f-90ea-2248fcc56c35" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.729225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f51d878-e0e5-415f-90ea-2248fcc56c35" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.729318] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f51d878-e0e5-415f-90ea-2248fcc56c35',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.759878] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.760198] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.760279] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.760490] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.760634] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.760781] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 2686e3e0-c528-42bb-9444-050209faa6b1 not found, creating... [ 595.761039] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.761195] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.761460] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.761520] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.761649] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.762010] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.762173] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.762285] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.762490] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.762617] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.762750] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 2686e3e0-c528-42bb-9444-050209faa6b1 is going to be created. [ 595.784448] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.784608] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.784692] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.785011] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.785288] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.785468] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-2686e3e0-c528-42bb-9444-050209faa6b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.036781] env[65102]: INFO networking_nsxv3.common.synchronization [None req-950201c7-6ce3-4da2-b7ae-6ffae32a46f2 None None] Enqueued Resource ID: ae709049-ebe6-48dd-bb27-eeb7c8a93f54 with Priority: HIGHEST for action port [ 596.037052] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae709049-ebe6-48dd-bb27-eeb7c8a93f54 with Priority: HIGHEST for action port [ 596.037613] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae709049-ebe6-48dd-bb27-eeb7c8a93f54 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.037742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae709049-ebe6-48dd-bb27-eeb7c8a93f54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.037809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae709049-ebe6-48dd-bb27-eeb7c8a93f54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.038751] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae709049-ebe6-48dd-bb27-eeb7c8a93f54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.038828] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae709049-ebe6-48dd-bb27-eeb7c8a93f54',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.232794] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f51d878-e0e5-415f-90ea-2248fcc56c35 [ 596.232794] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.232794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.232794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.233424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.233424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.233424] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f51d878-e0e5-415f-90ea-2248fcc56c35 already deleted. [ 596.233424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f51d878-e0e5-415f-90ea-2248fcc56c35" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.541015] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae709049-ebe6-48dd-bb27-eeb7c8a93f54 [ 596.541254] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.541388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.541466] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.541697] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.541834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.541940] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae709049-ebe6-48dd-bb27-eeb7c8a93f54 already deleted. [ 596.542068] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae709049-ebe6-48dd-bb27-eeb7c8a93f54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.808056] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb3f7653-3042-447f-9dc6-fdcea94161b2 req-8f30c3b7-b84d-41a9-bb85-660f72d3b3f6 tempest-DeleteServersAdminTestJSON-453173968 tempest-DeleteServersAdminTestJSON-453173968-project-member] Enqueued Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_members [ 596.808056] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_members [ 596.808546] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.808717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.808790] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.809087] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.809261] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.809389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.809856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.810139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.810252] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.810353] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.901127] env[65102]: INFO networking_nsxv3.common.synchronization [req-1098d80d-3092-4763-875f-f60296eaeeb9 req-53877608-c297-4e0d-8ce9-e5202a6ee237 service nova] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_rules [ 596.901983] env[65102]: INFO networking_nsxv3.common.synchronization [req-1098d80d-3092-4763-875f-f60296eaeeb9 req-53877608-c297-4e0d-8ce9-e5202a6ee237 service nova] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 596.905770] env[65102]: INFO networking_nsxv3.common.synchronization [req-1098d80d-3092-4763-875f-f60296eaeeb9 req-53877608-c297-4e0d-8ce9-e5202a6ee237 service nova] Enqueued Resource ID: 2686e3e0-c528-42bb-9444-050209faa6b1 with Priority: HIGHEST for action port [ 596.905770] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_rules [ 596.905770] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 596.905770] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2686e3e0-c528-42bb-9444-050209faa6b1 with Priority: HIGHEST for action port [ 596.905770] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.905770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.905770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.905770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.905770] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.905770] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.905770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.905770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.906610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.906610] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.907125] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.907169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.907368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.907406] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.907498] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.908715] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-2686e3e0-c528-42bb-9444-050209faa6b1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.908817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2686e3e0-c528-42bb-9444-050209faa6b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.908817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2686e3e0-c528-42bb-9444-050209faa6b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.909021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2686e3e0-c528-42bb-9444-050209faa6b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.909101] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2686e3e0-c528-42bb-9444-050209faa6b1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.237586] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.237586] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.237586] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.238173] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.238830] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.239096] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.239240] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.239929] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.240096] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.240477] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.240477] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.240550] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.240622] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.240731] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.240831] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.240988] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.272762] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.273125] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 597.273355] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.273639] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.274055] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-7518822c-68c7-4bd3-8296-e61bd76671e2 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.274307] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-7518822c-68c7-4bd3-8296-e61bd76671e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.274514] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-7518822c-68c7-4bd3-8296-e61bd76671e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.274941] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-7518822c-68c7-4bd3-8296-e61bd76671e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.275140] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7518822c-68c7-4bd3-8296-e61bd76671e2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.313319] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.313508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.313639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.313878] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.313998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.314242] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.314371] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.314456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.314641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.314728] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.314836] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a already deleted. [ 597.314932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.411788] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.411788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.424239] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2686e3e0-c528-42bb-9444-050209faa6b1 with status ACTIVE [ 597.424239] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.424239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.424239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.424239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.424239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.424553] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.424553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.424553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.424673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.425278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.425278] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.425278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.425278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.425278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.425278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.425538] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2686e3e0-c528-42bb-9444-050209faa6b1 is going to be updated. [ 597.426432] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.436122] env[65102]: INFO networking_nsxv3.common.synchronization [None req-e31e14b9-5031-4a13-905d-9971d7df3d98 None None] Enqueued Resource ID: 45fa2129-e8c7-428f-885b-9f4acf68a794 with Priority: HIGHEST for action port [ 597.436380] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45fa2129-e8c7-428f-885b-9f4acf68a794 with Priority: HIGHEST for action port [ 597.436925] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-45fa2129-e8c7-428f-885b-9f4acf68a794 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.437208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45fa2129-e8c7-428f-885b-9f4acf68a794" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.437208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45fa2129-e8c7-428f-885b-9f4acf68a794" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.437351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45fa2129-e8c7-428f-885b-9f4acf68a794" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.437410] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45fa2129-e8c7-428f-885b-9f4acf68a794',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.447880] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.448063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.448098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.448291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.448424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.448574] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2686e3e0-c528-42bb-9444-050209faa6b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.456016] env[65102]: INFO networking_nsxv3.common.synchronization [req-4e93a6c6-a13f-447a-afcf-03641ea9a008 req-d9c34f85-7550-4b2f-83f4-bce10b420a78 tempest-InstanceActionsTestJSON-1305569336 tempest-InstanceActionsTestJSON-1305569336-project-member] Enqueued Resource ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 with Priority: HIGHEST for action security_group_members [ 597.456347] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 with Priority: HIGHEST for action security_group_members [ 597.456683] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b26f4e0-5f0f-411f-8e44-f73309220261 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.456816] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.456893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.457141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.457298] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.457394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.457461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.457605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.457691] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.457785] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b26f4e0-5f0f-411f-8e44-f73309220261',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.777882] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.778214] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.778352] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.778643] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.778792] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.778964] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 7518822c-68c7-4bd3-8296-e61bd76671e2 not found, creating... [ 597.779304] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.779485] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.779649] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.779838] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.780395] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.780395] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.780562] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.782124] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.782124] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.782124] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.782124] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 7518822c-68c7-4bd3-8296-e61bd76671e2 is going to be created. [ 597.802025] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.802341] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.802436] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.802676] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.803054] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.803217] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-7518822c-68c7-4bd3-8296-e61bd76671e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.929315] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.933422] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.933609] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-121" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.933725] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-121" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.934046] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-121" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.934302] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.934453] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.934563] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.934775] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.934910] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.935124] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.935253] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.935341] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.935426] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.935637] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.935637] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.935737] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.939541] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45fa2129-e8c7-428f-885b-9f4acf68a794 [ 597.939715] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.939820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.939887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.940060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.940147] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.940237] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45fa2129-e8c7-428f-885b-9f4acf68a794 already deleted. [ 597.940318] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45fa2129-e8c7-428f-885b-9f4acf68a794" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.955368] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.955532] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 597.955652] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.955826] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-121" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.956158] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-d2435e56-5f0a-44e9-8154-2f2dd4103c55 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.956351] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-d2435e56-5f0a-44e9-8154-2f2dd4103c55" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.956438] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-d2435e56-5f0a-44e9-8154-2f2dd4103c55" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.956763] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-d2435e56-5f0a-44e9-8154-2f2dd4103c55" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.956898] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2435e56-5f0a-44e9-8154-2f2dd4103c55',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.959894] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.959894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.959894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.960201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.960201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.960360] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.960508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.960545] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.960677] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.960757] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.960879] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 already deleted. [ 597.960974] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.397725] env[65102]: INFO networking_nsxv3.common.synchronization [None req-d802a6c8-ddbe-4095-9aa4-e645b98cfdff None None] Enqueued Resource ID: 3d071271-f147-4b84-a93b-5289d7a3a568 with Priority: HIGHEST for action port [ 598.398541] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d071271-f147-4b84-a93b-5289d7a3a568 with Priority: HIGHEST for action port [ 598.399018] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d071271-f147-4b84-a93b-5289d7a3a568 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.399243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d071271-f147-4b84-a93b-5289d7a3a568" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.399370] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d071271-f147-4b84-a93b-5289d7a3a568" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.399739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d071271-f147-4b84-a93b-5289d7a3a568" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.399879] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d071271-f147-4b84-a93b-5289d7a3a568',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.431861] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.432173] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.432270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.432603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.432797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.432981] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be created. [ 598.460317] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.460605] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.460732] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.461198] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.461428] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.461597] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port d2435e56-5f0a-44e9-8154-2f2dd4103c55 not found, creating... [ 598.461905] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.462100] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.462216] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.462535] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.462681] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.463105] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.463329] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.463527] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.463844] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.464190] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.464460] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: d2435e56-5f0a-44e9-8154-2f2dd4103c55 is going to be created. [ 598.473774] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.474041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.474092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.474289] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.474449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.485890] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: UNINITIALIZED for 2s [ 598.495350] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.495579] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.495732] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.495951] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.496292] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.496508] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-d2435e56-5f0a-44e9-8154-2f2dd4103c55" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.554915] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb3f7653-3042-447f-9dc6-fdcea94161b2 req-f6e538e4-3bdf-45c9-96fa-0ddac78b7b23 service nova] Enqueued Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_rules [ 598.555164] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb3f7653-3042-447f-9dc6-fdcea94161b2 req-f6e538e4-3bdf-45c9-96fa-0ddac78b7b23 service nova] Enqueued Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_members [ 598.555379] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb3f7653-3042-447f-9dc6-fdcea94161b2 req-f6e538e4-3bdf-45c9-96fa-0ddac78b7b23 service nova] Enqueued Resource ID: 7518822c-68c7-4bd3-8296-e61bd76671e2 with Priority: HIGHEST for action port [ 598.555909] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_rules [ 598.556062] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_members [ 598.556166] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7518822c-68c7-4bd3-8296-e61bd76671e2 with Priority: HIGHEST for action port [ 598.556496] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.556584] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.556637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.557253] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.557253] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.558211] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.558338] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.558396] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.558578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.558728] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.558834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.558923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.559047] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.559134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.559220] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.560019] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-7518822c-68c7-4bd3-8296-e61bd76671e2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.560146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7518822c-68c7-4bd3-8296-e61bd76671e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.560204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7518822c-68c7-4bd3-8296-e61bd76671e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.560336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7518822c-68c7-4bd3-8296-e61bd76671e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.560406] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7518822c-68c7-4bd3-8296-e61bd76671e2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.903872] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d071271-f147-4b84-a93b-5289d7a3a568 [ 598.903872] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.903872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.903872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.903872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.903872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.903872] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d071271-f147-4b84-a93b-5289d7a3a568 already deleted. [ 598.903872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d071271-f147-4b84-a93b-5289d7a3a568" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.063141] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.063958] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.064086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.064470] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7518822c-68c7-4bd3-8296-e61bd76671e2 with status ACTIVE [ 599.064789] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.064855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.064887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.065279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.065478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.065653] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.065865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.065956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.067757] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.067854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.068066] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.068171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.068237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.068392] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.068473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.068561] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7518822c-68c7-4bd3-8296-e61bd76671e2 is going to be updated. [ 599.089705] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.089864] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.089959] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.090359] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.090432] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.090578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7518822c-68c7-4bd3-8296-e61bd76671e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.205237] env[65102]: INFO networking_nsxv3.common.synchronization [req-f800c330-731f-417a-92f9-c9f0303eb033 req-d86adcc5-e147-47c2-b6d8-35f6886cc136 tempest-ServersAdminTestJSON-1629823880 tempest-ServersAdminTestJSON-1629823880-project-member] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 599.206764] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 599.207325] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.207504] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.270805] env[65102]: INFO networking_nsxv3.common.synchronization [req-4e93a6c6-a13f-447a-afcf-03641ea9a008 req-0313354a-6c9a-4e48-9db4-12a1a512dd0c service nova] Enqueued Resource ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 with Priority: HIGHEST for action security_group_rules [ 599.270963] env[65102]: INFO networking_nsxv3.common.synchronization [req-4e93a6c6-a13f-447a-afcf-03641ea9a008 req-0313354a-6c9a-4e48-9db4-12a1a512dd0c service nova] Enqueued Resource ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 with Priority: HIGHEST for action security_group_members [ 599.271220] env[65102]: INFO networking_nsxv3.common.synchronization [req-4e93a6c6-a13f-447a-afcf-03641ea9a008 req-0313354a-6c9a-4e48-9db4-12a1a512dd0c service nova] Enqueued Resource ID: d2435e56-5f0a-44e9-8154-2f2dd4103c55 with Priority: HIGHEST for action port [ 599.271831] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 with Priority: HIGHEST for action security_group_rules [ 599.272174] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 with Priority: HIGHEST for action security_group_members [ 599.272174] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2435e56-5f0a-44e9-8154-2f2dd4103c55 with Priority: HIGHEST for action port [ 599.272928] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b26f4e0-5f0f-411f-8e44-f73309220261 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.272928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.272928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.273603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.273603] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b26f4e0-5f0f-411f-8e44-f73309220261',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.274431] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b26f4e0-5f0f-411f-8e44-f73309220261 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.274524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.274585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.274865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.275171] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.275366] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.275496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.275887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.275953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.276158] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b26f4e0-5f0f-411f-8e44-f73309220261',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.277019] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2435e56-5f0a-44e9-8154-2f2dd4103c55 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.277123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2435e56-5f0a-44e9-8154-2f2dd4103c55" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.278024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2435e56-5f0a-44e9-8154-2f2dd4103c55" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.278024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2435e56-5f0a-44e9-8154-2f2dd4103c55" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.278024] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2435e56-5f0a-44e9-8154-2f2dd4103c55',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.565558] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.608365] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-552 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.608365] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.608365] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.608365] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.608365] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.608570] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.608570] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.608742] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.608882] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.609204] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.609327] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.609439] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.609545] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.609653] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.609756] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.609885] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.629069] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.629241] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 599.629375] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.629552] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.629861] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-3ce4a5c1-5dae-42ba-919f-736e66893243 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.630041] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-3ce4a5c1-5dae-42ba-919f-736e66893243" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.630163] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-3ce4a5c1-5dae-42ba-919f-736e66893243" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.630474] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-3ce4a5c1-5dae-42ba-919f-736e66893243" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.630670] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ce4a5c1-5dae-42ba-919f-736e66893243',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.779105] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b26f4e0-5f0f-411f-8e44-f73309220261 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.779344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.779388] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b26f4e0-5f0f-411f-8e44-f73309220261',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.781050] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2435e56-5f0a-44e9-8154-2f2dd4103c55 with status ACTIVE [ 599.781050] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.781050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.781050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.781050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.781050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.781352] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.781352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.781352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.781465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.781501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.781798] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.781798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.781927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.781957] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.782045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.782131] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2435e56-5f0a-44e9-8154-2f2dd4103c55 is going to be updated. [ 599.805645] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.805845] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.805888] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.806108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.806264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.806430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2435e56-5f0a-44e9-8154-2f2dd4103c55" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.068351] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.068557] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.068596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.068784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.068872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.068971] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a is going to be created. [ 600.092919] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.092919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.093135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.093224] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.093383] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.103023] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a in Status: UNINITIALIZED for 2s [ 600.134034] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.134034] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.134262] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.134458] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.134580] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.134730] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 3ce4a5c1-5dae-42ba-919f-736e66893243 not found, creating... [ 600.135038] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.135217] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.135328] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.135689] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.135918] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.136265] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.136426] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.136542] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.136760] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.136949] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.137121] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 3ce4a5c1-5dae-42ba-919f-736e66893243 is going to be created. [ 600.158791] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.159038] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.159143] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.159483] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.159734] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.159996] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-3ce4a5c1-5dae-42ba-919f-736e66893243" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.284388] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b26f4e0-5f0f-411f-8e44-f73309220261',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.496595] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 600.496858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.497059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.497285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.497479] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.497631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.497691] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.497810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.498013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.498013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.498129] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.499190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.499256] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.499414] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.499519] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.499583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.499719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.499799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.499883] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.786596] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.786984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.786984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.787111] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.787167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.787316] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 is going to be created. [ 600.813616] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.813863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.813955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.814460] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.814585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.838970] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 in Status: UNINITIALIZED for 2s [ 600.879682] env[65102]: INFO networking_nsxv3.common.synchronization [req-f800c330-731f-417a-92f9-c9f0303eb033 req-79948dfc-69e1-44d5-a468-06bec05536cb service nova] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_rules [ 600.879976] env[65102]: INFO networking_nsxv3.common.synchronization [req-f800c330-731f-417a-92f9-c9f0303eb033 req-79948dfc-69e1-44d5-a468-06bec05536cb service nova] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 600.880193] env[65102]: INFO networking_nsxv3.common.synchronization [req-f800c330-731f-417a-92f9-c9f0303eb033 req-79948dfc-69e1-44d5-a468-06bec05536cb service nova] Enqueued Resource ID: 3ce4a5c1-5dae-42ba-919f-736e66893243 with Priority: HIGHEST for action port [ 600.880823] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_rules [ 600.880996] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 600.881183] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ce4a5c1-5dae-42ba-919f-736e66893243 with Priority: HIGHEST for action port [ 600.881523] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.881689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.881974] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.882151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.882463] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ce4a5c1-5dae-42ba-919f-736e66893243 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.882630] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ce4a5c1-5dae-42ba-919f-736e66893243" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.882734] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ce4a5c1-5dae-42ba-919f-736e66893243" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.883131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ce4a5c1-5dae-42ba-919f-736e66893243" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.883222] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ce4a5c1-5dae-42ba-919f-736e66893243',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.001442] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.001584] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.002811] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.296590] env[65102]: INFO networking_nsxv3.common.synchronization [None req-3407eddf-8fba-43f5-86e0-765f2eaed664 None None] Enqueued Resource ID: 1a78aa3c-6c37-4b7e-b1f5-ac6ce4f225be with Priority: HIGHEST for action port [ 601.296857] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a78aa3c-6c37-4b7e-b1f5-ac6ce4f225be with Priority: HIGHEST for action port [ 601.297415] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a78aa3c-6c37-4b7e-b1f5-ac6ce4f225be taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.297542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a78aa3c-6c37-4b7e-b1f5-ac6ce4f225be" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.297608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a78aa3c-6c37-4b7e-b1f5-ac6ce4f225be" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.297854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a78aa3c-6c37-4b7e-b1f5-ac6ce4f225be" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.297935] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a78aa3c-6c37-4b7e-b1f5-ac6ce4f225be',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.386978] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ce4a5c1-5dae-42ba-919f-736e66893243 with status ACTIVE [ 601.387243] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.387381] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.387449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.389652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.389652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.389652] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.389652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.389652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.389652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.389652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.389652] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.389652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.389652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.389652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.389652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.389652] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ce4a5c1-5dae-42ba-919f-736e66893243 is going to be updated. [ 601.409108] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.409258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.409327] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.410498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.410897] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.411175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ce4a5c1-5dae-42ba-919f-736e66893243" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.505586] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.801953] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a78aa3c-6c37-4b7e-b1f5-ac6ce4f225be [ 601.802278] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.802278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.802392] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.802968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.802968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.802968] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a78aa3c-6c37-4b7e-b1f5-ac6ce4f225be already deleted. [ 601.802968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a78aa3c-6c37-4b7e-b1f5-ac6ce4f225be" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.926246] env[65102]: INFO networking_nsxv3.common.synchronization [req-859d736f-33a6-4382-862b-6f0e1180160a req-b246b964-2a0e-47b3-a764-7c17f95a994c tempest-MigrationsAdminTest-673773847 tempest-MigrationsAdminTest-673773847-project-member] Enqueued Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_members [ 601.926758] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_members [ 601.927068] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.927384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.927384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.927516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.928074] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.928074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.928074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.928074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.931948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.932335] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.008513] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.008733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.008782] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.008962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.009101] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.009163] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be updated. [ 602.047697] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.047891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.047931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.048264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.048454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.057155] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 602.113997] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a in Status: SUCCESS [ 602.114230] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.114324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.115091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.115091] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.115091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.115091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.115876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.115876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.115876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.115876] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.251303] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.251499] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.251614] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.251873] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.252144] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.252355] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.252483] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.252700] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.252840] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.253085] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.253200] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.253304] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.253408] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.253512] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.253611] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.253735] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.279440] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.279629] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.279629] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.279752] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.280063] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-086361c0-3cd7-4389-b5f0-c550a2adc834 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.280229] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-086361c0-3cd7-4389-b5f0-c550a2adc834" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.280341] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-086361c0-3cd7-4389-b5f0-c550a2adc834" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.280669] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-086361c0-3cd7-4389-b5f0-c550a2adc834" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.280818] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('086361c0-3cd7-4389-b5f0-c550a2adc834',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.435378] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.435535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.435593] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.435843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.435890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.436099] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.436203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.436264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.436418] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.436489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.436576] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 already deleted. [ 602.436657] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.618553] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.618711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.619343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.619343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.619343] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.619525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.619525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.619591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.620173] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.620173] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.620173] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.620173] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.620173] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.620391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.620391] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.620479] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.620538] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.620689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.620761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.620841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.620957] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.784329] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.784750] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.784750] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.785086] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.785131] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.785299] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 086361c0-3cd7-4389-b5f0-c550a2adc834 not found, creating... [ 602.785563] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.785743] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.785856] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.786094] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.786228] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.786801] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.786801] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.786801] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.787127] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.787327] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.787522] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 086361c0-3cd7-4389-b5f0-c550a2adc834 is going to be created. [ 602.817414] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.817787] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.817787] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.818121] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.818343] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.818575] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-086361c0-3cd7-4389-b5f0-c550a2adc834" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.852659] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 in Status: SUCCESS [ 602.853013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.854045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.854045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.854045] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.854045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.854045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.854332] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.854369] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.854491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.854630] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b26f4e0-5f0f-411f-8e44-f73309220261',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.126666] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a: rpc.has_security_group_logging(os_id): False [ 603.147295] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.147456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.147524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.147733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.147816] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.148010] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.148113] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.148168] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.148320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.148392] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.148592] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.148679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.148736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.148875] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.148950] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.149144] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.149236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.149298] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.149424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.149498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.149581] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a is going to be created. [ 603.216451] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.216451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.216451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.216451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.216451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.232240] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a in Status: IN_PROGRESS for 2s [ 603.357461] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b26f4e0-5f0f-411f-8e44-f73309220261 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.357631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.357694] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.358026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.358134] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.358205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.358285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.358419] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.358540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.358658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.358940] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b26f4e0-5f0f-411f-8e44-f73309220261 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.359117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.359172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.360186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.360186] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.360186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.360186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.360186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.360186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.360186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.360186] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b26f4e0-5f0f-411f-8e44-f73309220261',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.563114] env[65102]: INFO networking_nsxv3.common.synchronization [None req-46ae5a92-a9f2-48bd-82ae-fe82632b5b02 None None] Enqueued Resource ID: 25ab7522-79e7-4398-b9e8-d8a56902c63d with Priority: HIGHEST for action port [ 603.563668] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ab7522-79e7-4398-b9e8-d8a56902c63d with Priority: HIGHEST for action port [ 603.564342] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-25ab7522-79e7-4398-b9e8-d8a56902c63d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.564918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25ab7522-79e7-4398-b9e8-d8a56902c63d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.565022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25ab7522-79e7-4398-b9e8-d8a56902c63d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.565353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25ab7522-79e7-4398-b9e8-d8a56902c63d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.565353] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25ab7522-79e7-4398-b9e8-d8a56902c63d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.672305] env[65102]: INFO networking_nsxv3.common.synchronization [req-859d736f-33a6-4382-862b-6f0e1180160a req-42404631-90ce-4fea-9c9d-e34232c33cc4 service nova] Enqueued Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_rules [ 603.672582] env[65102]: INFO networking_nsxv3.common.synchronization [req-859d736f-33a6-4382-862b-6f0e1180160a req-42404631-90ce-4fea-9c9d-e34232c33cc4 service nova] Enqueued Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_members [ 603.672756] env[65102]: INFO networking_nsxv3.common.synchronization [req-859d736f-33a6-4382-862b-6f0e1180160a req-42404631-90ce-4fea-9c9d-e34232c33cc4 service nova] Enqueued Resource ID: 086361c0-3cd7-4389-b5f0-c550a2adc834 with Priority: HIGHEST for action port [ 603.673429] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_rules [ 603.673625] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_members [ 603.673878] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086361c0-3cd7-4389-b5f0-c550a2adc834 with Priority: HIGHEST for action port [ 603.674277] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.674472] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.674733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.674982] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.675182] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.676791] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.677621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.677776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.678080] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.678331] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.678502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.678726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.678964] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.679113] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.679912] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.680567] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-086361c0-3cd7-4389-b5f0-c550a2adc834 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.680567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-086361c0-3cd7-4389-b5f0-c550a2adc834" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.680567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-086361c0-3cd7-4389-b5f0-c550a2adc834" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.680769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-086361c0-3cd7-4389-b5f0-c550a2adc834" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.680872] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('086361c0-3cd7-4389-b5f0-c550a2adc834',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.862327] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b26f4e0-5f0f-411f-8e44-f73309220261: rpc.has_security_group_logging(os_id): False [ 603.881527] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.881670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.881746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.881957] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.882378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.882594] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.882702] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.882769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.883117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.883117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.883247] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.883393] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.883393] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.883536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.883611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.883803] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.883899] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.883984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.884143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.884222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.884310] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 is going to be created. [ 603.946972] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.946972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.947167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.947369] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.947652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.962311] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 in Status: IN_PROGRESS for 2s [ 603.970490] env[65102]: INFO networking_nsxv3.common.synchronization [req-1419320e-3f79-4c8a-9e73-c94778eb2f56 req-f912c251-e0f0-4e94-8256-db31bcebb7b1 tempest-ServerDiagnosticsNegativeTest-1730136242 tempest-ServerDiagnosticsNegativeTest-1730136242-project-member] Enqueued Resource ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 with Priority: HIGHEST for action security_group_members [ 603.970739] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 with Priority: HIGHEST for action security_group_members [ 603.971138] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.971267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.971331] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.971582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.971736] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.971838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.971905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.974441] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.974441] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.974441] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9ff44a-eecd-47a3-a497-f84ebc9294a5',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.067595] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25ab7522-79e7-4398-b9e8-d8a56902c63d [ 604.067854] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.067995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.068110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.068364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.068487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.068614] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25ab7522-79e7-4398-b9e8-d8a56902c63d already deleted. [ 604.068741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25ab7522-79e7-4398-b9e8-d8a56902c63d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.075037] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 604.075037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.075037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.075037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.075037] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.075037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.075037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.075367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.075367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.075776] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.184040] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.184302] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.184401] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.185319] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 086361c0-3cd7-4389-b5f0-c550a2adc834 with status ACTIVE [ 604.185819] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.185819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.185819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.185986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.185986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.186140] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.186267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.186306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.186446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.186525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.186703] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.186793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.186890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.186978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.190902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.191461] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 086361c0-3cd7-4389-b5f0-c550a2adc834 is going to be updated. [ 604.217354] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.217522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.217522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.217715] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.217858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.218026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-086361c0-3cd7-4389-b5f0-c550a2adc834" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.325437] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.325681] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.325739] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.326432] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.326432] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.326432] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.326622] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.326703] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.326844] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.327740] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.329016] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.329145] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.329292] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.329366] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.329463] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.329589] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.349519] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.349713] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 604.350273] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.350273] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.351172] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-74eb113e-24ab-43aa-bb1c-e5427ac59a2a taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.351365] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-74eb113e-24ab-43aa-bb1c-e5427ac59a2a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.351483] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-74eb113e-24ab-43aa-bb1c-e5427ac59a2a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.352406] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-74eb113e-24ab-43aa-bb1c-e5427ac59a2a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.352406] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74eb113e-24ab-43aa-bb1c-e5427ac59a2a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.475889] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.476061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.476137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.476355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.476501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.476647] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.476743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.476825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.476943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.477039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.477126] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 already deleted. [ 604.477206] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.577468] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.695593] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.854195] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.854464] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.854587] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.854911] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.855211] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.855332] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 74eb113e-24ab-43aa-bb1c-e5427ac59a2a not found, creating... [ 604.855765] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.856148] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.856244] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.856589] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.856785] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.857143] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.857323] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.857435] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.857787] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.857873] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.857948] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 74eb113e-24ab-43aa-bb1c-e5427ac59a2a is going to be created. [ 604.880474] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.880757] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.880910] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.881234] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.881479] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.881763] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-74eb113e-24ab-43aa-bb1c-e5427ac59a2a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.082735] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.198061] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.198326] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.198326] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.198643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.198754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.198858] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 is going to be created. [ 605.226251] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.226416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.226491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.226716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.226881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.238533] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: UNINITIALIZED for 2s [ 605.242390] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a in Status: SUCCESS [ 605.242636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.585430] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.585527] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.585527] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.585793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.585843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.585926] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be updated. [ 605.604342] env[65102]: INFO networking_nsxv3.common.synchronization [req-1419320e-3f79-4c8a-9e73-c94778eb2f56 req-1d33b710-0a86-4927-9fd7-f23f0610d6af service nova] Enqueued Resource ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 with Priority: HIGHEST for action security_group_rules [ 605.604550] env[65102]: INFO networking_nsxv3.common.synchronization [req-1419320e-3f79-4c8a-9e73-c94778eb2f56 req-1d33b710-0a86-4927-9fd7-f23f0610d6af service nova] Enqueued Resource ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 with Priority: HIGHEST for action security_group_members [ 605.604705] env[65102]: INFO networking_nsxv3.common.synchronization [req-1419320e-3f79-4c8a-9e73-c94778eb2f56 req-1d33b710-0a86-4927-9fd7-f23f0610d6af service nova] Enqueued Resource ID: 74eb113e-24ab-43aa-bb1c-e5427ac59a2a with Priority: HIGHEST for action port [ 605.605253] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 with Priority: HIGHEST for action security_group_rules [ 605.605461] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 with Priority: HIGHEST for action security_group_members [ 605.605461] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74eb113e-24ab-43aa-bb1c-e5427ac59a2a with Priority: HIGHEST for action port [ 605.605752] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad9ff44a-eecd-47a3-a497-f84ebc9294a5 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.605932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.605999] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.606312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.606312] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad9ff44a-eecd-47a3-a497-f84ebc9294a5',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.608020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.608020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.608020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.608020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.608020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.608020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.608020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.608263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.608263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.608263] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9ff44a-eecd-47a3-a497-f84ebc9294a5',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.609547] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-74eb113e-24ab-43aa-bb1c-e5427ac59a2a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.609547] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74eb113e-24ab-43aa-bb1c-e5427ac59a2a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.609547] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74eb113e-24ab-43aa-bb1c-e5427ac59a2a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.609547] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74eb113e-24ab-43aa-bb1c-e5427ac59a2a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.609547] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74eb113e-24ab-43aa-bb1c-e5427ac59a2a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.616847] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.617036] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.617099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.617280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.617428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.631632] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 605.979917] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 in Status: SUCCESS [ 605.980276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.111858] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad9ff44a-eecd-47a3-a497-f84ebc9294a5',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.113032] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.113185] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.113310] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74eb113e-24ab-43aa-bb1c-e5427ac59a2a with status ACTIVE [ 606.113481] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.113584] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.113652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.113875] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.113963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.114117] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.114243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.114304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.114435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.114512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.114673] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.114854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.114854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.114977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.115056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.115151] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74eb113e-24ab-43aa-bb1c-e5427ac59a2a is going to be updated. [ 606.138482] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.138482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.138482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.139207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.139207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.139207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74eb113e-24ab-43aa-bb1c-e5427ac59a2a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.617334] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad9ff44a-eecd-47a3-a497-f84ebc9294a5',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.124804] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.124804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.124804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.124804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.124804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.124804] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 is going to be created. [ 607.150779] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.151560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.152285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.154588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.154588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.166060] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 in Status: UNINITIALIZED for 2s [ 607.249230] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: UNINITIALIZED for 4s [ 607.643338] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 607.643587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.643781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.644101] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.644296] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.644435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.644517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.644688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.644761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.644871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.645073] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.645178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.645238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.645381] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.645523] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.645614] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.645674] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.645814] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.645887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.645992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.646215] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.148740] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6a41d40-0a8b-401c-801a-f31f69ae007f: rpc.has_security_group_logging(os_id): False [ 608.167393] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.167393] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.167393] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.167663] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.167663] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.167842] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.167930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.168030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.168130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.168248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.168498] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.168498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.168498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.168638] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.168728] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.168900] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.169125] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.169608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.169799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.169884] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.169976] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be created. [ 608.267286] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.267464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.267587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.267740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.267931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.281725] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 609.177186] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 in Status: SUCCESS [ 609.177461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.177579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.178056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.178381] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.178483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.178524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.178681] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.178768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.178855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.178944] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad9ff44a-eecd-47a3-a497-f84ebc9294a5',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.263538] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: SUCCESS [ 609.263895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.264124] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.264384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.264588] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.264750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.264849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.264988] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.265094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.265198] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.265302] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.683742] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.683742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.683742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.683742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.683742] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.683742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.683742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.683742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.683742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.683742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.686258] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.686427] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.686484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.686621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.686778] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.686876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.686936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.687099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.687183] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.687270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.687363] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad9ff44a-eecd-47a3-a497-f84ebc9294a5',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.768509] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.770453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.770546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.770764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.771044] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.771163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.771226] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.771390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.771471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.771555] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.771713] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.771800] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.771858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.771993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.772141] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.772230] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.772288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.773984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.773984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.773984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.773984] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.931683] env[65102]: INFO networking_nsxv3.common.synchronization [None req-6c724a61-da45-4527-9745-5d37119c9932 tempest-ServersWithSpecificFlavorTestJSON-1123838888 tempest-ServersWithSpecificFlavorTestJSON-1123838888-project-member] Enqueued Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_rules [ 609.933787] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_rules [ 609.933787] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.933787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.933787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.933787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.933787] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.189737] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad9ff44a-eecd-47a3-a497-f84ebc9294a5: rpc.has_security_group_logging(os_id): False [ 610.208409] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.208610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.208610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.208801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.208919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.209092] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.209185] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.209359] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.209487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.209572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.209769] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.209869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.209926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.210142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.210342] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.210418] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.210496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.210561] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.210698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.210776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.210861] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 is going to be created. [ 610.266459] env[65102]: INFO networking_nsxv3.common.synchronization [None req-f7586e32-415e-4bd8-a605-7a76991e5c0d tempest-ServersWithSpecificFlavorTestJSON-1123838888 tempest-ServersWithSpecificFlavorTestJSON-1123838888-project-member] Enqueued Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_rules [ 610.267125] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_rules [ 610.267531] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.267663] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.271642] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.271770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.271837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.272050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.272243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.275029] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5a72f78-b26f-4670-a8f0-eea902ebea26: rpc.has_security_group_logging(os_id): False [ 610.286814] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 in Status: IN_PROGRESS for 2s [ 610.295486] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.295658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.295721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.295934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.296046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.296289] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.296397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.296497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.296662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.296746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.296936] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.297212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.297212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.297288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.297320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.297503] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.297599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.298080] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.298080] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.298080] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.298080] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 is going to be created. [ 610.299831] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 610.299915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.300433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.300596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.300717] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.390877] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.391122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.391204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.391417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.391599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.412369] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: IN_PROGRESS for 2s [ 610.458972] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.459184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.459251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.459523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.459668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.459755] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a already deleted. [ 610.459858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.460063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.460277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.460357] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.803585] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.803803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.803803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.807244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.807244] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.807244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.807244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.807244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.807244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.807244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.807244] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.985996] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.986208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.986208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.986397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.986488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.986630] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a already deleted. [ 610.986719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.021161] env[65102]: INFO networking_nsxv3.common.synchronization [None req-19585cbf-79c4-4375-9bc0-073ce769bfee None None] Enqueued Resource ID: 917d5662-7776-4ced-a35e-403b9637c278 with Priority: HIGHEST for action port [ 611.021907] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 917d5662-7776-4ced-a35e-403b9637c278 with Priority: HIGHEST for action port [ 611.022157] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-917d5662-7776-4ced-a35e-403b9637c278 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.022304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-917d5662-7776-4ced-a35e-403b9637c278" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.022392] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-917d5662-7776-4ced-a35e-403b9637c278" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.022820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-917d5662-7776-4ced-a35e-403b9637c278" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.023079] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('917d5662-7776-4ced-a35e-403b9637c278',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.311915] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.312300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.312300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.312600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.312858] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.312988] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.313082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.313273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.313359] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.313448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.313606] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.313703] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.313779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.313951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.314114] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.314211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.314374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.314574] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.314907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.314907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.314907] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.526896] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 917d5662-7776-4ced-a35e-403b9637c278 [ 611.527268] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.527429] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.527502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.527693] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.527810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.527893] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:917d5662-7776-4ced-a35e-403b9637c278 already deleted. [ 611.527970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-917d5662-7776-4ced-a35e-403b9637c278" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.818551] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6a41d40-0a8b-401c-801a-f31f69ae007f: rpc.has_security_group_logging(os_id): False [ 611.839719] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.841891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.841976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.842220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.842321] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.842537] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.842642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.842705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.846108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.846108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.846108] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.846108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.846108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.846108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.846108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.846108] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.846108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.846108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.846108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.846108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.846108] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be updated. [ 611.849793] env[65102]: INFO networking_nsxv3.common.synchronization [None req-e30a022c-c8cf-44ae-abab-ee3038d89612 None None] Enqueued Resource ID: d937c854-a274-4aa0-b889-a0bc6a13bc99 with Priority: HIGHEST for action port [ 611.851012] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d937c854-a274-4aa0-b889-a0bc6a13bc99 with Priority: HIGHEST for action port [ 611.851345] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d937c854-a274-4aa0-b889-a0bc6a13bc99 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.851505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d937c854-a274-4aa0-b889-a0bc6a13bc99" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.851571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d937c854-a274-4aa0-b889-a0bc6a13bc99" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.851775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d937c854-a274-4aa0-b889-a0bc6a13bc99" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.851859] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d937c854-a274-4aa0-b889-a0bc6a13bc99',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.924205] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.924381] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.924464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.924651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.924805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.954135] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 612.355401] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d937c854-a274-4aa0-b889-a0bc6a13bc99 [ 612.355654] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.355779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.355841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.356874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.357033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.357141] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d937c854-a274-4aa0-b889-a0bc6a13bc99 already deleted. [ 612.357232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d937c854-a274-4aa0-b889-a0bc6a13bc99" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.379817] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 in Status: SUCCESS [ 612.379817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.426196] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: SUCCESS [ 612.426490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.848029] env[65102]: INFO networking_nsxv3.common.synchronization [req-54b14cf9-3d6e-468d-8f25-782fb211f9cf req-01718d70-44d9-4799-9247-1e3ea758f1fb tempest-VolumesAssistedSnapshotsTest-997297769 tempest-VolumesAssistedSnapshotsTest-997297769-project-member] Enqueued Resource ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c with Priority: HIGHEST for action security_group_members [ 612.851524] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c with Priority: HIGHEST for action security_group_members [ 612.851524] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.851524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.851524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.851524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.851524] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.851524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.851524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.851524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.851524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.851524] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('687f9a90-8cf8-4c0f-bfe9-b1800ef9665c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.347103] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-56 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.347289] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-56" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.347418] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-56" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.347745] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-56" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.347992] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.348927] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.349069] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.349850] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.350116] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.350288] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.350398] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.351057] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.351057] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.351057] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.351057] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.351057] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.355454] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.355765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.355765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.355927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.356078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.357423] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.357531] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.357602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.357835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.357928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.358048] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c already deleted. [ 613.358222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.372895] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.372895] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.372895] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.372895] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-56" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.372895] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-e41be772-a45d-410b-acaf-09d30f9afa9d taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.374112] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-e41be772-a45d-410b-acaf-09d30f9afa9d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.374289] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-e41be772-a45d-410b-acaf-09d30f9afa9d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.374622] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-e41be772-a45d-410b-acaf-09d30f9afa9d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.374757] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e41be772-a45d-410b-acaf-09d30f9afa9d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.577713] env[65102]: INFO networking_nsxv3.common.synchronization [None req-e9ff6b18-7aa5-4e84-a5e2-f39dd1c3b51e None None] Enqueued Resource ID: c26fb553-c58d-4b01-be35-19a9f5745271 with Priority: HIGHEST for action port [ 613.578377] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26fb553-c58d-4b01-be35-19a9f5745271 with Priority: HIGHEST for action port [ 613.578829] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-c26fb553-c58d-4b01-be35-19a9f5745271 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.579105] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c26fb553-c58d-4b01-be35-19a9f5745271" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.579180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c26fb553-c58d-4b01-be35-19a9f5745271" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.579516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c26fb553-c58d-4b01-be35-19a9f5745271" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.579653] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c26fb553-c58d-4b01-be35-19a9f5745271',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.780524] env[65102]: INFO networking_nsxv3.common.synchronization [None req-059c57de-9f27-4865-9a5c-5f8d4fc5bd07 None None] Enqueued Resource ID: 94898efd-738d-4b80-af26-9a1e4f578075 with Priority: HIGHEST for action port [ 613.781189] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94898efd-738d-4b80-af26-9a1e4f578075 with Priority: HIGHEST for action port [ 613.781555] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-94898efd-738d-4b80-af26-9a1e4f578075 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.781707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94898efd-738d-4b80-af26-9a1e4f578075" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.781707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94898efd-738d-4b80-af26-9a1e4f578075" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.781958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94898efd-738d-4b80-af26-9a1e4f578075" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.782045] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94898efd-738d-4b80-af26-9a1e4f578075',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.878104] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.878365] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.878572] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.879438] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.879699] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.879932] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port e41be772-a45d-410b-acaf-09d30f9afa9d not found, creating... [ 613.880336] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.880578] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.880776] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.881108] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.881265] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.881671] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.881857] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.881988] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.882221] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.882359] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.882501] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: e41be772-a45d-410b-acaf-09d30f9afa9d is going to be created. [ 613.912697] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.913248] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.913378] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.913771] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.914281] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.914646] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-e41be772-a45d-410b-acaf-09d30f9afa9d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.983777] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 613.983777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.081615] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c26fb553-c58d-4b01-be35-19a9f5745271 [ 614.081926] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.082030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.082030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.082287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.082413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.082413] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c26fb553-c58d-4b01-be35-19a9f5745271 already deleted. [ 614.082554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c26fb553-c58d-4b01-be35-19a9f5745271" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.284639] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94898efd-738d-4b80-af26-9a1e4f578075 [ 614.284906] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.285078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.285145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.285386] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.285566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.285566] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94898efd-738d-4b80-af26-9a1e4f578075 already deleted. [ 614.285803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94898efd-738d-4b80-af26-9a1e4f578075" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.640044] env[65102]: INFO networking_nsxv3.common.synchronization [req-54b14cf9-3d6e-468d-8f25-782fb211f9cf req-3f54a8ec-c41c-4265-8a14-da405f0fb4a7 service nova] Enqueued Resource ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c with Priority: HIGHEST for action security_group_rules [ 614.640044] env[65102]: INFO networking_nsxv3.common.synchronization [req-54b14cf9-3d6e-468d-8f25-782fb211f9cf req-3f54a8ec-c41c-4265-8a14-da405f0fb4a7 service nova] Enqueued Resource ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c with Priority: HIGHEST for action security_group_members [ 614.640044] env[65102]: INFO networking_nsxv3.common.synchronization [req-54b14cf9-3d6e-468d-8f25-782fb211f9cf req-3f54a8ec-c41c-4265-8a14-da405f0fb4a7 service nova] Enqueued Resource ID: e41be772-a45d-410b-acaf-09d30f9afa9d with Priority: HIGHEST for action port [ 614.640044] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c with Priority: HIGHEST for action security_group_rules [ 614.640044] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c with Priority: HIGHEST for action security_group_members [ 614.640044] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e41be772-a45d-410b-acaf-09d30f9afa9d with Priority: HIGHEST for action port [ 614.640583] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.640583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.640583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.640914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.640914] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('687f9a90-8cf8-4c0f-bfe9-b1800ef9665c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.643449] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.643588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.643654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.643959] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.644051] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.644653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.644719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.644915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.645487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.645649] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('687f9a90-8cf8-4c0f-bfe9-b1800ef9665c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.647282] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-e41be772-a45d-410b-acaf-09d30f9afa9d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.647449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e41be772-a45d-410b-acaf-09d30f9afa9d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.647513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e41be772-a45d-410b-acaf-09d30f9afa9d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.648288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e41be772-a45d-410b-acaf-09d30f9afa9d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.648400] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e41be772-a45d-410b-acaf-09d30f9afa9d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.112428] env[65102]: INFO networking_nsxv3.common.synchronization [None req-e7f826fa-c13c-4ae2-a2a9-3f03f59c339b None None] Enqueued Resource ID: ea5b3675-cac4-4646-abe8-ffdd31f7a532 with Priority: HIGHEST for action port [ 615.112428] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea5b3675-cac4-4646-abe8-ffdd31f7a532 with Priority: HIGHEST for action port [ 615.114936] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea5b3675-cac4-4646-abe8-ffdd31f7a532 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.114936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea5b3675-cac4-4646-abe8-ffdd31f7a532" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.114936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea5b3675-cac4-4646-abe8-ffdd31f7a532" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.114936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea5b3675-cac4-4646-abe8-ffdd31f7a532" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.114936] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea5b3675-cac4-4646-abe8-ffdd31f7a532',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.148933] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('687f9a90-8cf8-4c0f-bfe9-b1800ef9665c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.156095] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e41be772-a45d-410b-acaf-09d30f9afa9d with status ACTIVE [ 615.156095] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.156095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.156095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.156095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.156095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.156095] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.156095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.156095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.156983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.156983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.156983] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.156983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.157232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.157290] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.157915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.157915] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e41be772-a45d-410b-acaf-09d30f9afa9d is going to be updated. [ 615.158993] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.158993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.186254] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.188513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.188513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.188513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.188513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.188513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e41be772-a45d-410b-acaf-09d30f9afa9d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.463666] env[65102]: INFO networking_nsxv3.common.synchronization [req-3babe0bb-30d6-4056-9f53-5a9200f0ed4e req-001469fe-8a23-4088-be12-489fd222a0fd tempest-FloatingIPsAssociationNegativeTestJSON-1021891016 tempest-FloatingIPsAssociationNegativeTestJSON-1021891016-project-member] Enqueued Resource ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 with Priority: HIGHEST for action security_group_members [ 615.464695] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 with Priority: HIGHEST for action security_group_members [ 615.465291] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.465576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.465781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.466231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.466653] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.467042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.467042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.467371] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.467808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.467808] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48a0698b-8c00-4295-9ba0-bc4c6ebdca57',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.617160] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea5b3675-cac4-4646-abe8-ffdd31f7a532 [ 615.617419] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.617582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.617690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.617876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.617978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.618065] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea5b3675-cac4-4646-abe8-ffdd31f7a532 already deleted. [ 615.618161] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea5b3675-cac4-4646-abe8-ffdd31f7a532" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.660500] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('687f9a90-8cf8-4c0f-bfe9-b1800ef9665c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.961692] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-476 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.961817] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-476" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.961960] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-476" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.962324] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-476" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.962636] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.962768] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.962910] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.963497] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.963675] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.963965] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.964106] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.964214] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.964931] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.964931] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.964931] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.964931] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.973777] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.974052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.974145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.974818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.974818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.974818] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.974999] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.974999] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.975884] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.975884] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.975884] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 already deleted. [ 615.975884] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.987475] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.987637] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.987976] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.989117] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-476" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.989117] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-02108638-8e1e-447a-9b94-a45adfd32161 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.989117] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-02108638-8e1e-447a-9b94-a45adfd32161" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.989117] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-02108638-8e1e-447a-9b94-a45adfd32161" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.991514] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-02108638-8e1e-447a-9b94-a45adfd32161" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.991727] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02108638-8e1e-447a-9b94-a45adfd32161',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.163394] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.163694] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.163813] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.164136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.164266] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.164405] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c is going to be created. [ 616.191043] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.191264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.191322] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.191547] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.191786] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.207061] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c in Status: UNINITIALIZED for 2s [ 616.470240] env[65102]: INFO networking_nsxv3.common.synchronization [None req-a84cb96f-88c3-4549-904f-eb08aa6e2244 None None] Enqueued Resource ID: c5d18d53-41f5-43e9-a92f-df0b00757b98 with Priority: HIGHEST for action port [ 616.470826] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5d18d53-41f5-43e9-a92f-df0b00757b98 with Priority: HIGHEST for action port [ 616.471905] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5d18d53-41f5-43e9-a92f-df0b00757b98 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.472047] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5d18d53-41f5-43e9-a92f-df0b00757b98" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.472182] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5d18d53-41f5-43e9-a92f-df0b00757b98" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.472368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5d18d53-41f5-43e9-a92f-df0b00757b98" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.472492] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5d18d53-41f5-43e9-a92f-df0b00757b98',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.495311] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.495539] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.495660] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.495935] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.496085] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.496235] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 02108638-8e1e-447a-9b94-a45adfd32161 not found, creating... [ 616.496490] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.496637] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.496746] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.496990] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.497153] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.497439] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.497589] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.497724] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.497933] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.498457] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.498637] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 02108638-8e1e-447a-9b94-a45adfd32161 is going to be created. [ 616.531824] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.532160] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.532357] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.533396] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.533585] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.534063] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-02108638-8e1e-447a-9b94-a45adfd32161" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.769979] env[65102]: INFO networking_nsxv3.common.synchronization [req-17cd3f6e-50fa-41fa-9360-31234ce986bc req-1112776c-92ec-4141-ba0e-84fed8120e50 tempest-MultipleCreateTestJSON-827681759 tempest-MultipleCreateTestJSON-827681759-project-member] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 616.771289] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 616.771289] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.771289] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.771289] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.771469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.771657] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.771780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.771892] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.772028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.772142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.772286] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.976454] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5d18d53-41f5-43e9-a92f-df0b00757b98 [ 616.976454] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.976454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.976454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.976454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.976454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.976454] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5d18d53-41f5-43e9-a92f-df0b00757b98 already deleted. [ 616.976454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5d18d53-41f5-43e9-a92f-df0b00757b98" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.276108] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.276793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.276793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.276793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.276793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.277103] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.277251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.277333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.277539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.277644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.277956] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 already deleted. [ 617.277956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.281353] env[65102]: INFO networking_nsxv3.common.synchronization [req-3babe0bb-30d6-4056-9f53-5a9200f0ed4e req-c8d3c8c6-6776-49d7-ba85-94cb5914ed85 service nova] Enqueued Resource ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 with Priority: HIGHEST for action security_group_rules [ 617.281612] env[65102]: INFO networking_nsxv3.common.synchronization [req-3babe0bb-30d6-4056-9f53-5a9200f0ed4e req-c8d3c8c6-6776-49d7-ba85-94cb5914ed85 service nova] Enqueued Resource ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 with Priority: HIGHEST for action security_group_members [ 617.281796] env[65102]: INFO networking_nsxv3.common.synchronization [req-3babe0bb-30d6-4056-9f53-5a9200f0ed4e req-c8d3c8c6-6776-49d7-ba85-94cb5914ed85 service nova] Enqueued Resource ID: 02108638-8e1e-447a-9b94-a45adfd32161 with Priority: HIGHEST for action port [ 617.282507] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 with Priority: HIGHEST for action security_group_rules [ 617.282645] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 with Priority: HIGHEST for action security_group_members [ 617.282980] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02108638-8e1e-447a-9b94-a45adfd32161 with Priority: HIGHEST for action port [ 617.283401] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48a0698b-8c00-4295-9ba0-bc4c6ebdca57 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.283560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.283621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.286298] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.286298] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48a0698b-8c00-4295-9ba0-bc4c6ebdca57',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.287278] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.287766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.287766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.287766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.287766] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.288095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.288095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.288095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.288269] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.288269] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48a0698b-8c00-4295-9ba0-bc4c6ebdca57',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.291573] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-02108638-8e1e-447a-9b94-a45adfd32161 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.291736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02108638-8e1e-447a-9b94-a45adfd32161" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.292312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02108638-8e1e-447a-9b94-a45adfd32161" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.292312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02108638-8e1e-447a-9b94-a45adfd32161" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.292312] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02108638-8e1e-447a-9b94-a45adfd32161',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.356245] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.356463] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.356569] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.356890] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.358159] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.358159] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.358159] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.358159] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.358159] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.358159] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.358159] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.358159] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.358658] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.358658] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.358658] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.358658] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.378213] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.378455] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 617.378600] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.378773] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.379247] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-d06bc826-4580-47a4-a3b4-841380ee155f taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.379360] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-d06bc826-4580-47a4-a3b4-841380ee155f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.379411] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-d06bc826-4580-47a4-a3b4-841380ee155f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.379698] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-d06bc826-4580-47a4-a3b4-841380ee155f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.379829] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d06bc826-4580-47a4-a3b4-841380ee155f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.797021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.797021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.797021] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48a0698b-8c00-4295-9ba0-bc4c6ebdca57',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.797021] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02108638-8e1e-447a-9b94-a45adfd32161 with status ACTIVE [ 617.797021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.797021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.797021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.797021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.797021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.797021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.797021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.797021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.797021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.797021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.797859] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.797859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.797859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.798481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.798585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.798678] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02108638-8e1e-447a-9b94-a45adfd32161 is going to be updated. [ 617.822534] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.822812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.822812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.823025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.823169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.823327] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02108638-8e1e-447a-9b94-a45adfd32161" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.882570] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.882570] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.882921] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.883047] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.883165] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.883338] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port d06bc826-4580-47a4-a3b4-841380ee155f not found, creating... [ 617.883624] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.883792] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.884080] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.884178] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.884327] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.884624] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.884796] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.884912] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.885185] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.885348] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.885497] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: d06bc826-4580-47a4-a3b4-841380ee155f is going to be created. [ 617.906956] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.907329] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.907556] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.907976] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.908339] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.908685] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-d06bc826-4580-47a4-a3b4-841380ee155f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.218138] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c in Status: SUCCESS [ 618.218397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.218583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.218803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.218998] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.219134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.219202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.219360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.219444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.219532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.219625] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('687f9a90-8cf8-4c0f-bfe9-b1800ef9665c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.301500] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48a0698b-8c00-4295-9ba0-bc4c6ebdca57',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.621332] env[65102]: INFO networking_nsxv3.common.synchronization [req-17cd3f6e-50fa-41fa-9360-31234ce986bc req-407f0cf7-e6bc-44e1-ae78-97ed9dc95911 service nova] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_rules [ 618.621500] env[65102]: INFO networking_nsxv3.common.synchronization [req-17cd3f6e-50fa-41fa-9360-31234ce986bc req-407f0cf7-e6bc-44e1-ae78-97ed9dc95911 service nova] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 618.621637] env[65102]: INFO networking_nsxv3.common.synchronization [req-17cd3f6e-50fa-41fa-9360-31234ce986bc req-407f0cf7-e6bc-44e1-ae78-97ed9dc95911 service nova] Enqueued Resource ID: d06bc826-4580-47a4-a3b4-841380ee155f with Priority: HIGHEST for action port [ 618.622188] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_rules [ 618.622322] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 618.622422] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d06bc826-4580-47a4-a3b4-841380ee155f with Priority: HIGHEST for action port [ 618.622829] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.622910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.622960] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.623429] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.623517] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.625627] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.625727] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.625727] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.625887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.626052] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.626151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.626207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.626348] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.626429] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.626519] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.628192] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d06bc826-4580-47a4-a3b4-841380ee155f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.628336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d06bc826-4580-47a4-a3b4-841380ee155f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.628403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d06bc826-4580-47a4-a3b4-841380ee155f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.628656] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d06bc826-4580-47a4-a3b4-841380ee155f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.628739] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d06bc826-4580-47a4-a3b4-841380ee155f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.722442] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('687f9a90-8cf8-4c0f-bfe9-b1800ef9665c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.805713] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.805713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.805713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.805713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.805713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.805713] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 is going to be created. [ 618.830956] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.831511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.831678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.831992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.832273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.843831] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 in Status: UNINITIALIZED for 2s [ 619.083065] env[65102]: INFO networking_nsxv3.common.synchronization [req-17cd3f6e-50fa-41fa-9360-31234ce986bc req-baa576fa-81b5-44e4-aeca-48b261c61db7 tempest-MultipleCreateTestJSON-827681759 tempest-MultipleCreateTestJSON-827681759-project-member] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 619.083615] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 619.083965] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.084083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.126558] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.126891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.129139] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.130930] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d06bc826-4580-47a4-a3b4-841380ee155f with status ACTIVE [ 619.130930] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.130930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.130930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.130930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.130930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.131249] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.131311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.131361] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.131646] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.131646] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.131770] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.131872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.131917] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.132181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.132181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.132292] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d06bc826-4580-47a4-a3b4-841380ee155f is going to be updated. [ 619.155414] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.155586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.156049] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.156049] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.156049] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.156332] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d06bc826-4580-47a4-a3b4-841380ee155f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.223939] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c: rpc.has_security_group_logging(os_id): False [ 619.245241] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.245422] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.245422] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.245625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.245714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.246168] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.246168] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.246331] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.246367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.246455] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.246594] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c is going to be created. [ 619.346684] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.346684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.346684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.346684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.346684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.361019] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c in Status: IN_PROGRESS for 2s [ 619.413024] env[65102]: INFO networking_nsxv3.common.synchronization [None req-9ab6d058-66ab-4e5f-b0f5-ec343fcc82b0 None None] Enqueued Resource ID: e7f5b3a7-eba2-452a-87f5-493f1c5bebb5 with Priority: HIGHEST for action port [ 619.413024] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7f5b3a7-eba2-452a-87f5-493f1c5bebb5 with Priority: HIGHEST for action port [ 619.413585] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7f5b3a7-eba2-452a-87f5-493f1c5bebb5 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.413922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7f5b3a7-eba2-452a-87f5-493f1c5bebb5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.415991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7f5b3a7-eba2-452a-87f5-493f1c5bebb5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.415991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7f5b3a7-eba2-452a-87f5-493f1c5bebb5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.415991] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7f5b3a7-eba2-452a-87f5-493f1c5bebb5',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.583501] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.583672] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.583795] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.584131] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.584390] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.584546] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.584656] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.584867] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.585101] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.585249] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.585359] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.585463] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.585567] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.585672] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.585792] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.585895] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.603196] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.603434] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.603609] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.603799] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.604146] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-b41e2bb0-3a13-473d-ac19-0e593444f482 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.604324] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-b41e2bb0-3a13-473d-ac19-0e593444f482" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.604450] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-b41e2bb0-3a13-473d-ac19-0e593444f482" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.604781] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-b41e2bb0-3a13-473d-ac19-0e593444f482" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.604915] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b41e2bb0-3a13-473d-ac19-0e593444f482',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.634135] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.917372] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7f5b3a7-eba2-452a-87f5-493f1c5bebb5 [ 619.917804] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.917994] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.918144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.918377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.918474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.918571] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7f5b3a7-eba2-452a-87f5-493f1c5bebb5 already deleted. [ 619.918653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7f5b3a7-eba2-452a-87f5-493f1c5bebb5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.108755] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.109100] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.109182] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.109405] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.109663] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.109869] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port b41e2bb0-3a13-473d-ac19-0e593444f482 not found, creating... [ 620.110226] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.110398] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.110523] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.110757] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.110901] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.111223] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.111375] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.111483] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.111694] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.111823] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.111971] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: b41e2bb0-3a13-473d-ac19-0e593444f482 is going to be created. [ 620.137605] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.137605] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.137605] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.137605] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.137819] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.138023] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-b41e2bb0-3a13-473d-ac19-0e593444f482" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.139008] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.139144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.139211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.139386] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.139469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.139559] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be created. [ 620.164316] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.164496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.164545] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.164717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.164877] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.176169] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: UNINITIALIZED for 2s [ 620.285883] env[65102]: INFO networking_nsxv3.common.synchronization [None req-ec022e60-2780-487b-9271-2a01e64793ad tempest-ServersTestBootFromVolume-630499006 tempest-ServersTestBootFromVolume-630499006-project-member] Enqueued Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGHEST for action security_group_rules [ 620.287391] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGHEST for action security_group_rules [ 620.288111] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14808516-a2e0-455d-83e1-fa5b5fe0e828 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.290442] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.290442] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.290442] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.290442] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14808516-a2e0-455d-83e1-fa5b5fe0e828',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.450900] env[65102]: INFO networking_nsxv3.common.synchronization [None req-74721452-2f2c-446e-af9a-a254070d85e3 tempest-ServersTestBootFromVolume-630499006 tempest-ServersTestBootFromVolume-630499006-project-member] Enqueued Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGHEST for action security_group_rules [ 620.451569] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGHEST for action security_group_rules [ 620.452032] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14808516-a2e0-455d-83e1-fa5b5fe0e828 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.452032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.815098] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.815098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.815098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.815098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.815098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.815098] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 already deleted. [ 620.815098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.815098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.815098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.815098] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14808516-a2e0-455d-83e1-fa5b5fe0e828',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.869397] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 in Status: SUCCESS [ 620.869397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.869397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.869397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.869397] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.869397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.869397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.869397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.869397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.869397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.869397] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48a0698b-8c00-4295-9ba0-bc4c6ebdca57',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.025177] env[65102]: INFO networking_nsxv3.common.synchronization [req-17cd3f6e-50fa-41fa-9360-31234ce986bc req-68549a77-8517-4936-8cf1-751b5aa09ffb service nova] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_rules [ 621.025454] env[65102]: INFO networking_nsxv3.common.synchronization [req-17cd3f6e-50fa-41fa-9360-31234ce986bc req-68549a77-8517-4936-8cf1-751b5aa09ffb service nova] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 621.025498] env[65102]: INFO networking_nsxv3.common.synchronization [req-17cd3f6e-50fa-41fa-9360-31234ce986bc req-68549a77-8517-4936-8cf1-751b5aa09ffb service nova] Enqueued Resource ID: b41e2bb0-3a13-473d-ac19-0e593444f482 with Priority: HIGHEST for action port [ 621.027275] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_rules [ 621.027275] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 621.027275] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b41e2bb0-3a13-473d-ac19-0e593444f482 with Priority: HIGHEST for action port [ 621.028783] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.028783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.028783] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.028783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.028783] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b41e2bb0-3a13-473d-ac19-0e593444f482 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.028783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b41e2bb0-3a13-473d-ac19-0e593444f482" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.028783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b41e2bb0-3a13-473d-ac19-0e593444f482" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.028783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b41e2bb0-3a13-473d-ac19-0e593444f482" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.028783] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b41e2bb0-3a13-473d-ac19-0e593444f482',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.340333] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.340516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.340588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.340883] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.340989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.341111] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 already deleted. [ 621.341681] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.368080] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.368780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.369062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.369390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.369778] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.370063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.370562] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.370562] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.370847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.372017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.372017] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.372017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.372017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.372017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.372017] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.372017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.372017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.374366] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.374366] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.374366] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.374366] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48a0698b-8c00-4295-9ba0-bc4c6ebdca57',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.376832] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c in Status: SUCCESS [ 621.376832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.531367] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b41e2bb0-3a13-473d-ac19-0e593444f482 with status ACTIVE [ 621.531613] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.531761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.531873] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.532127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.532222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.532407] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.532505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.532567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.532716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.532813] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.533017] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.533115] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.533167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.533325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.533387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.533451] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b41e2bb0-3a13-473d-ac19-0e593444f482 is going to be updated. [ 621.556362] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.556362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.556362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.556362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.556362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.556362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b41e2bb0-3a13-473d-ac19-0e593444f482" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.687040] env[65102]: INFO networking_nsxv3.common.synchronization [None req-597fbbaa-357a-451f-8715-8ea926d875ff None None] Enqueued Resource ID: 8a106f18-7d9a-49f4-bfd2-b0445c50dfba with Priority: HIGHEST for action port [ 621.687040] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a106f18-7d9a-49f4-bfd2-b0445c50dfba with Priority: HIGHEST for action port [ 621.687040] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a106f18-7d9a-49f4-bfd2-b0445c50dfba taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.687040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a106f18-7d9a-49f4-bfd2-b0445c50dfba" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.687040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a106f18-7d9a-49f4-bfd2-b0445c50dfba" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.687040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a106f18-7d9a-49f4-bfd2-b0445c50dfba" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.687040] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a106f18-7d9a-49f4-bfd2-b0445c50dfba',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.875269] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48a0698b-8c00-4295-9ba0-bc4c6ebdca57: rpc.has_security_group_logging(os_id): False [ 621.898256] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.898419] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.898478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.898692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.898871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.899083] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.899166] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.899203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.899373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.899436] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.899596] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.899675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.899731] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.899965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.899965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.900116] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.900116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.900372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.900578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.900578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.900578] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 is going to be created. [ 621.981335] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.981335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.981335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.981335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.981335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.995962] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 in Status: IN_PROGRESS for 2s [ 622.187082] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 622.187354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.187491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.187817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.187888] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.188023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.188078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.188241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.188325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.188420] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.189672] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a106f18-7d9a-49f4-bfd2-b0445c50dfba [ 622.189853] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.189964] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.190039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.190289] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.190289] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.190424] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a106f18-7d9a-49f4-bfd2-b0445c50dfba already deleted. [ 622.190424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a106f18-7d9a-49f4-bfd2-b0445c50dfba" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.693294] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.134662] env[65102]: INFO networking_nsxv3.common.synchronization [req-9d118051-74b2-4029-8ac3-3410116a4ac9 req-cc71c489-1976-4640-8047-3be4200557e5 tempest-TenantUsagesTestJSON-55507538 tempest-TenantUsagesTestJSON-55507538-project-member] Enqueued Resource ID: 645542ed-d50b-43c7-9870-1006fec2c84f with Priority: HIGHEST for action security_group_members [ 623.134662] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645542ed-d50b-43c7-9870-1006fec2c84f with Priority: HIGHEST for action security_group_members [ 623.135185] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-645542ed-d50b-43c7-9870-1006fec2c84f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.135272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.135323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.135672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.135743] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.135869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.135937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.136460] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.136587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.136731] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645542ed-d50b-43c7-9870-1006fec2c84f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.194893] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.342829] env[65102]: INFO networking_nsxv3.common.synchronization [None req-202fb609-ac7e-42fd-81f9-991082ef32d8 tempest-AttachInterfacesUnderV243Test-1550338923 tempest-AttachInterfacesUnderV243Test-1550338923-project-member] Enqueued Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_rules [ 623.343458] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_rules [ 623.343790] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4d20b00-9518-4813-be00-1234d826f6c1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.344031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.344031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.344305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.344398] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.642723] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.642989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.643084] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.643882] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.643882] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.643882] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.643882] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.643882] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.644238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.644238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.644238] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645542ed-d50b-43c7-9870-1006fec2c84f already deleted. [ 623.644331] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.698053] env[65102]: INFO networking_nsxv3.common.synchronization [None req-2065ce2b-111e-4456-8e57-2a375d521dc1 tempest-AttachInterfacesUnderV243Test-1550338923 tempest-AttachInterfacesUnderV243Test-1550338923-project-member] Enqueued Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_rules [ 623.698660] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_rules [ 623.698985] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4d20b00-9518-4813-be00-1234d826f6c1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.699116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.701412] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.702013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.702013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.702013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.702013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.702013] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be updated. [ 623.724085] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.724277] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.724403] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.724663] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.725603] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.725603] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.725603] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.725778] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.726545] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.726545] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.726545] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.726545] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.726545] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.726545] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.727036] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.727036] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.735211] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.735464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.735464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.735631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.735773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.746059] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: IN_PROGRESS for 2s [ 623.748017] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.748223] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.748370] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.748544] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.748893] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-20915f30-cfbb-4a09-bf64-495545e0096f taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.749106] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-20915f30-cfbb-4a09-bf64-495545e0096f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.749241] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-20915f30-cfbb-4a09-bf64-495545e0096f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.749563] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-20915f30-cfbb-4a09-bf64-495545e0096f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.749714] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20915f30-cfbb-4a09-bf64-495545e0096f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.872677] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.872943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.872994] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.873219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.873309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.873425] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4d20b00-9518-4813-be00-1234d826f6c1 already deleted. [ 623.873501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.873644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.873842] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.873936] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.009846] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 in Status: SUCCESS [ 624.010243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.253013] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.253523] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.253523] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.253649] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.253719] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.253876] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 20915f30-cfbb-4a09-bf64-495545e0096f not found, creating... [ 624.254216] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.254406] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.254594] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.254803] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.254992] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.256334] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.256334] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.256334] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.256334] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.256334] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.256334] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 20915f30-cfbb-4a09-bf64-495545e0096f is going to be created. [ 624.279788] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.279995] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.280271] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.280559] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.281189] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.281189] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-20915f30-cfbb-4a09-bf64-495545e0096f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.400206] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.400388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.400989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.400989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.400989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.400989] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4d20b00-9518-4813-be00-1234d826f6c1 already deleted. [ 624.400989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.073834] env[65102]: INFO networking_nsxv3.common.synchronization [req-9d118051-74b2-4029-8ac3-3410116a4ac9 req-7d84fe6c-a94a-4ea2-a4c7-347e979faa45 service nova] Enqueued Resource ID: 645542ed-d50b-43c7-9870-1006fec2c84f with Priority: HIGHEST for action security_group_rules [ 625.073834] env[65102]: INFO networking_nsxv3.common.synchronization [req-9d118051-74b2-4029-8ac3-3410116a4ac9 req-7d84fe6c-a94a-4ea2-a4c7-347e979faa45 service nova] Enqueued Resource ID: 645542ed-d50b-43c7-9870-1006fec2c84f with Priority: HIGHEST for action security_group_members [ 625.073834] env[65102]: INFO networking_nsxv3.common.synchronization [req-9d118051-74b2-4029-8ac3-3410116a4ac9 req-7d84fe6c-a94a-4ea2-a4c7-347e979faa45 service nova] Enqueued Resource ID: 20915f30-cfbb-4a09-bf64-495545e0096f with Priority: HIGHEST for action port [ 625.075428] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645542ed-d50b-43c7-9870-1006fec2c84f with Priority: HIGHEST for action security_group_rules [ 625.075591] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645542ed-d50b-43c7-9870-1006fec2c84f with Priority: HIGHEST for action security_group_members [ 625.075726] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20915f30-cfbb-4a09-bf64-495545e0096f with Priority: HIGHEST for action port [ 625.076139] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-645542ed-d50b-43c7-9870-1006fec2c84f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.076337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.076337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.076981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.076981] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('645542ed-d50b-43c7-9870-1006fec2c84f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.078146] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-645542ed-d50b-43c7-9870-1006fec2c84f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.078146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.078146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.078396] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.078478] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.079081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.079081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.079081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.079081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.079081] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645542ed-d50b-43c7-9870-1006fec2c84f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.080153] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-20915f30-cfbb-4a09-bf64-495545e0096f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.080267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20915f30-cfbb-4a09-bf64-495545e0096f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.080343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20915f30-cfbb-4a09-bf64-495545e0096f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.080478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20915f30-cfbb-4a09-bf64-495545e0096f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.080580] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20915f30-cfbb-4a09-bf64-495545e0096f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.582252] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-645542ed-d50b-43c7-9870-1006fec2c84f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.582588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.583724] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('645542ed-d50b-43c7-9870-1006fec2c84f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.585590] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20915f30-cfbb-4a09-bf64-495545e0096f with status ACTIVE [ 625.587132] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.587132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.587132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.587384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.587561] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.587817] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.588868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.589099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.589288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.589812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.590138] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.591665] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.591759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.592024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.592155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.592339] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20915f30-cfbb-4a09-bf64-495545e0096f is going to be updated. [ 625.628379] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.628900] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.629518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.629786] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.629927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.630156] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20915f30-cfbb-4a09-bf64-495545e0096f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.762749] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 625.763127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.763590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.763716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.764044] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.764357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.764357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.764635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.764778] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.764933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.765741] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.766713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.766949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.767174] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.767323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.767412] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.767604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.768239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.768239] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.095730] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('645542ed-d50b-43c7-9870-1006fec2c84f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.271752] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.271752] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.271752] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.599035] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.599496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.599496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.599496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.599496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.599938] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645542ed-d50b-43c7-9870-1006fec2c84f is going to be created. [ 626.631109] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.631358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.631358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.631517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.631689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.644069] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645542ed-d50b-43c7-9870-1006fec2c84f in Status: UNINITIALIZED for 2s [ 626.780049] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.978811] env[65102]: INFO networking_nsxv3.common.synchronization [None req-0fe7c22a-9210-412b-a85d-abe00668be01 None None] Enqueued Resource ID: 50cdc29f-41ad-43ad-ad7d-3383c13f243d with Priority: HIGHEST for action port [ 626.980035] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50cdc29f-41ad-43ad-ad7d-3383c13f243d with Priority: HIGHEST for action port [ 626.980035] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-50cdc29f-41ad-43ad-ad7d-3383c13f243d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.980602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50cdc29f-41ad-43ad-ad7d-3383c13f243d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.980602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50cdc29f-41ad-43ad-ad7d-3383c13f243d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.982471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50cdc29f-41ad-43ad-ad7d-3383c13f243d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.982637] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50cdc29f-41ad-43ad-ad7d-3383c13f243d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.101994] env[65102]: INFO networking_nsxv3.common.synchronization [req-98638bf8-0071-486d-acc5-67041a180688 req-abe31ae3-af37-48ac-b85a-13bf88002d43 tempest-DeleteServersAdminTestJSON-703408665 tempest-DeleteServersAdminTestJSON-703408665-project-admin] Enqueued Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_members [ 627.103953] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_members [ 627.104385] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.105447] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.105569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.105815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.106031] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.106140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.106206] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.106370] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.106508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.106610] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.285660] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.285660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.285660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.286991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.286991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.286991] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be updated. [ 627.329303] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.329443] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.329514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.329729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.329879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.342800] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: IN_PROGRESS for 2s [ 627.487451] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50cdc29f-41ad-43ad-ad7d-3383c13f243d [ 627.487568] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.487729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.487729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.487910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.488052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.488101] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50cdc29f-41ad-43ad-ad7d-3383c13f243d already deleted. [ 627.488186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50cdc29f-41ad-43ad-ad7d-3383c13f243d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.522689] env[65102]: INFO networking_nsxv3.common.synchronization [None req-fe5ff1d1-0d8a-4146-a532-00b29dc96528 None None] Enqueued Resource ID: 358dcad3-11c1-4809-814c-568559b6a79e with Priority: HIGHEST for action port [ 627.523162] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 358dcad3-11c1-4809-814c-568559b6a79e with Priority: HIGHEST for action port [ 627.523396] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-358dcad3-11c1-4809-814c-568559b6a79e taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.523523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-358dcad3-11c1-4809-814c-568559b6a79e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.523586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-358dcad3-11c1-4809-814c-568559b6a79e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.524096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-358dcad3-11c1-4809-814c-568559b6a79e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.524096] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('358dcad3-11c1-4809-814c-568559b6a79e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.608891] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.609254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.609254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.611535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.611535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.611535] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.611535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.611535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.611535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.611535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.611535] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a is going to be updated. [ 627.648632] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.648775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.648775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.648955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.650430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.660748] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a in Status: IN_PROGRESS for 2s [ 628.026427] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 358dcad3-11c1-4809-814c-568559b6a79e [ 628.027972] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.028170] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.028244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.028464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.028557] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.028657] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:358dcad3-11c1-4809-814c-568559b6a79e already deleted. [ 628.028745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-358dcad3-11c1-4809-814c-568559b6a79e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.196152] env[65102]: INFO networking_nsxv3.common.synchronization [req-b289553a-89d6-4cb3-a9eb-b9f1edd283c9 req-7908c9fc-d608-4194-8652-b7a866809170 tempest-ServersWithSpecificFlavorTestJSON-1123838888 tempest-ServersWithSpecificFlavorTestJSON-1123838888-project-member] Enqueued Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_members [ 628.196152] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_members [ 628.196152] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.196152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.196482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.196482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.196968] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.196968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.196968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.196968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.196968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.202098] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.656783] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645542ed-d50b-43c7-9870-1006fec2c84f in Status: SUCCESS [ 628.657093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.658682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.658682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.658682] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.658682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.658682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.658682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.658682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.658682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.658682] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('645542ed-d50b-43c7-9870-1006fec2c84f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.701996] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.702207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.702294] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.702446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.704973] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.705576] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.705761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.705863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.706135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.707121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.707284] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a already deleted. [ 628.707476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.052353] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-379 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.052557] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-379" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.052668] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-379" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.053115] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-379" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.054037] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.054037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.054037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.054037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.054339] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.054639] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.054691] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.054981] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.054981] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.054981] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.055119] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.055216] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.077036] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.077247] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 629.077359] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.077537] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-379" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.077850] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-3bb17344-0031-4226-9117-1366ecf93330 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.078034] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-3bb17344-0031-4226-9117-1366ecf93330" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.078152] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-3bb17344-0031-4226-9117-1366ecf93330" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.078474] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-3bb17344-0031-4226-9117-1366ecf93330" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.078606] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bb17344-0031-4226-9117-1366ecf93330',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.162630] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-645542ed-d50b-43c7-9870-1006fec2c84f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.163506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.163506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.163506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.163695] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.164061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.164061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.164178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.164285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.164349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.164523] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-645542ed-d50b-43c7-9870-1006fec2c84f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.164617] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.164676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.164820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.165391] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.165507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.165551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.165739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.165834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.166106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.166106] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('645542ed-d50b-43c7-9870-1006fec2c84f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.353081] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 629.353347] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.353893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.354149] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.354363] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.354486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.354563] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.354731] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.354823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.354920] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.355102] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.355206] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.355271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.355416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.355580] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.355673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.355760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.355957] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.356067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.356141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.356236] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.479623] env[65102]: INFO networking_nsxv3.common.synchronization [None req-42978f12-41fa-4658-89b7-995cfe0e61db None None] Enqueued Resource ID: b2158e58-c41c-4dfa-ae60-172a7ada8f72 with Priority: HIGHEST for action port [ 629.481071] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2158e58-c41c-4dfa-ae60-172a7ada8f72 with Priority: HIGHEST for action port [ 629.481071] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2158e58-c41c-4dfa-ae60-172a7ada8f72 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.481071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2158e58-c41c-4dfa-ae60-172a7ada8f72" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.481311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2158e58-c41c-4dfa-ae60-172a7ada8f72" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.481579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2158e58-c41c-4dfa-ae60-172a7ada8f72" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.481680] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2158e58-c41c-4dfa-ae60-172a7ada8f72',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.582594] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.582594] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.582594] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.582594] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.582942] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.582942] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 3bb17344-0031-4226-9117-1366ecf93330 not found, creating... [ 629.583966] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.583966] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.583966] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.584195] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.584272] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.584874] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.585395] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.585395] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.585625] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.585772] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.585809] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 3bb17344-0031-4226-9117-1366ecf93330 is going to be created. [ 629.608854] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.608854] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.608854] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.608854] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.608854] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.609735] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-3bb17344-0031-4226-9117-1366ecf93330" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.670242] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 645542ed-d50b-43c7-9870-1006fec2c84f: rpc.has_security_group_logging(os_id): False [ 629.672789] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a in Status: SUCCESS [ 629.672789] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a deletion is rescheduled due to dependency. [ 629.672789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.688978] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.689146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.689496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.689811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.689945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.690220] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.691204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.691286] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.691454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.691541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.691822] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.691929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.691995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.692162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.692301] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.692538] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.692643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.692800] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.692935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.693079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.693256] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 645542ed-d50b-43c7-9870-1006fec2c84f is going to be created. [ 629.798920] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.799192] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.799244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.799497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.799711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.829573] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645542ed-d50b-43c7-9870-1006fec2c84f in Status: IN_PROGRESS for 2s [ 629.858930] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1: rpc.has_security_group_logging(os_id): False [ 629.894325] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.894550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.894605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.894803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.894922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.895171] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.895280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.895344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.895536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.896053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.897891] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.899107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.899791] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.900111] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.900213] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.900526] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.900672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.900750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.900973] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.901139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.901830] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be created. [ 629.974151] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.974151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.974151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.974151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.974151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.983702] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2158e58-c41c-4dfa-ae60-172a7ada8f72 [ 629.984109] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.984411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.984411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.984722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.984880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.985044] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2158e58-c41c-4dfa-ae60-172a7ada8f72 already deleted. [ 629.985188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2158e58-c41c-4dfa-ae60-172a7ada8f72" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.990261] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: IN_PROGRESS for 2s [ 630.083813] env[65102]: INFO networking_nsxv3.common.synchronization [None req-38ef2c7c-769d-485a-bd52-fa71184c1885 None None] Enqueued Resource ID: 869916e6-a61a-4444-9381-707d981798ea with Priority: HIGHEST for action port [ 630.084421] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 869916e6-a61a-4444-9381-707d981798ea with Priority: HIGHEST for action port [ 630.088232] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-869916e6-a61a-4444-9381-707d981798ea taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.088232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-869916e6-a61a-4444-9381-707d981798ea" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.088232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-869916e6-a61a-4444-9381-707d981798ea" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.088232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-869916e6-a61a-4444-9381-707d981798ea" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.088232] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('869916e6-a61a-4444-9381-707d981798ea',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.134177] env[65102]: INFO networking_nsxv3.common.synchronization [req-12ff576d-219d-4d86-8d14-68bddbc0047f req-c88a4303-d1e8-4ddd-b7e5-23d90d6a864a tempest-ListImageFiltersTestJSON-812883063 tempest-ListImageFiltersTestJSON-812883063-project-member] Enqueued Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_members [ 630.135836] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_members [ 630.135836] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.135836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.135836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.135836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.136136] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.136136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.136136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.136255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.136342] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.137366] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.422724] env[65102]: INFO networking_nsxv3.common.synchronization [req-b289553a-89d6-4cb3-a9eb-b9f1edd283c9 req-0be5ff34-c1ac-4c5f-83a6-c89746c29947 service nova] Enqueued Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_rules [ 630.422724] env[65102]: INFO networking_nsxv3.common.synchronization [req-b289553a-89d6-4cb3-a9eb-b9f1edd283c9 req-0be5ff34-c1ac-4c5f-83a6-c89746c29947 service nova] Enqueued Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_members [ 630.422724] env[65102]: INFO networking_nsxv3.common.synchronization [req-b289553a-89d6-4cb3-a9eb-b9f1edd283c9 req-0be5ff34-c1ac-4c5f-83a6-c89746c29947 service nova] Enqueued Resource ID: 3bb17344-0031-4226-9117-1366ecf93330 with Priority: HIGHEST for action port [ 630.422724] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_rules [ 630.422724] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_members [ 630.422724] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bb17344-0031-4226-9117-1366ecf93330 with Priority: HIGHEST for action port [ 630.422724] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.422724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.422724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.424207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.424207] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.427689] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.427689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.427689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.427689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.427689] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.427689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.427689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.427689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.427689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.427689] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.427689] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bb17344-0031-4226-9117-1366ecf93330 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.427689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bb17344-0031-4226-9117-1366ecf93330" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.427689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bb17344-0031-4226-9117-1366ecf93330" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.427689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bb17344-0031-4226-9117-1366ecf93330" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.427689] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bb17344-0031-4226-9117-1366ecf93330',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.592509] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 869916e6-a61a-4444-9381-707d981798ea [ 630.592740] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.592906] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.592980] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.593218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.593310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.593423] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:869916e6-a61a-4444-9381-707d981798ea already deleted. [ 630.593493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-869916e6-a61a-4444-9381-707d981798ea" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.630710] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.630974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.631193] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.631470] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.631727] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.631880] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.631997] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.632286] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.632430] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.632628] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.632978] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.633121] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.633241] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.633347] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.633452] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.633580] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.638272] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.638389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.638527] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.638614] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.638700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.638931] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.639120] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.639120] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.639360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.639444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.639444] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 already deleted. [ 630.639634] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.653859] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.654157] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.654402] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.654690] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.655205] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-0b52bca6-ff8c-4322-9b18-1c1129186df6 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.655500] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-0b52bca6-ff8c-4322-9b18-1c1129186df6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.655721] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-0b52bca6-ff8c-4322-9b18-1c1129186df6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.656195] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-0b52bca6-ff8c-4322-9b18-1c1129186df6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.656434] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b52bca6-ff8c-4322-9b18-1c1129186df6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.791418] env[65102]: INFO networking_nsxv3.common.synchronization [req-347b3519-af5b-4732-8546-3508f3c4a7a2 req-5579a221-4e73-4e86-b5b8-f8af0a29be86 tempest-DeleteServersTestJSON-1773899535 tempest-DeleteServersTestJSON-1773899535-project-member] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 630.793172] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 630.793618] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.794355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.794460] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.795277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.795465] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.795586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.795650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.795839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.795921] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.795980] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.929866] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.931037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.931037] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.931882] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bb17344-0031-4226-9117-1366ecf93330 with status ACTIVE [ 630.932187] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.932533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.932533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.932733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.932874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.933797] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.933935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.934030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.934309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.934444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.934721] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.934874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.934972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.935224] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.935347] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.935481] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bb17344-0031-4226-9117-1366ecf93330 is going to be updated. [ 630.965479] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.965479] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.965479] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.965706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.965740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.965895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bb17344-0031-4226-9117-1366ecf93330" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.159319] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.159448] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.159510] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.159779] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.159942] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.160127] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 0b52bca6-ff8c-4322-9b18-1c1129186df6 not found, creating... [ 631.160382] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.160535] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.160645] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.160866] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.161500] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.161871] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.162195] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.162374] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.162619] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.162842] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.163038] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 0b52bca6-ff8c-4322-9b18-1c1129186df6 is going to be created. [ 631.164779] env[65102]: INFO networking_nsxv3.common.synchronization [None req-88ec183d-4360-432a-a53c-55c9e9061042 None None] Enqueued Resource ID: 090b45d3-586a-4804-b95b-49d709e333df with Priority: HIGHEST for action port [ 631.165461] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 090b45d3-586a-4804-b95b-49d709e333df with Priority: HIGHEST for action port [ 631.166286] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-090b45d3-586a-4804-b95b-49d709e333df taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.166552] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-090b45d3-586a-4804-b95b-49d709e333df" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.167235] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-090b45d3-586a-4804-b95b-49d709e333df" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.167235] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-090b45d3-586a-4804-b95b-49d709e333df" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.167235] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('090b45d3-586a-4804-b95b-49d709e333df',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.186111] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.186225] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.186387] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.186603] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.187329] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.187329] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-0b52bca6-ff8c-4322-9b18-1c1129186df6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.209329] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.209600] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.209684] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.210047] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.212102] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.212302] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.212419] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.212660] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.212991] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.213086] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.213200] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.213302] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.213401] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.213506] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.213605] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.213733] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.232935] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.233132] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 631.233513] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.233513] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.233781] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-d9b6f78e-710c-4b4c-a9bd-04632f29764a taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.234015] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-d9b6f78e-710c-4b4c-a9bd-04632f29764a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.234138] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-d9b6f78e-710c-4b4c-a9bd-04632f29764a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.234440] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-d9b6f78e-710c-4b4c-a9bd-04632f29764a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.234569] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9b6f78e-710c-4b4c-a9bd-04632f29764a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.299772] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.299990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.299990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.300313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.300420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.300643] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.300770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.300817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.300987] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.301083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.301172] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f already deleted. [ 631.301257] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.439055] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.672239] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 090b45d3-586a-4804-b95b-49d709e333df [ 631.672485] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.672626] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.672700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.673017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.673122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.673222] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:090b45d3-586a-4804-b95b-49d709e333df already deleted. [ 631.673300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-090b45d3-586a-4804-b95b-49d709e333df" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.737688] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.737688] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.737688] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.737688] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.737688] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.737688] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port d9b6f78e-710c-4b4c-a9bd-04632f29764a not found, creating... [ 631.738105] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.738105] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.738208] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.738679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.738679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.738965] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.738965] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.739075] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.739722] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.739722] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.739722] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: d9b6f78e-710c-4b4c-a9bd-04632f29764a is going to be created. [ 631.763280] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.763280] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.763280] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.763280] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.763280] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.763505] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-d9b6f78e-710c-4b4c-a9bd-04632f29764a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.846336] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 645542ed-d50b-43c7-9870-1006fec2c84f in Status: SUCCESS [ 631.846585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.916164] env[65102]: INFO networking_nsxv3.common.synchronization [req-12ff576d-219d-4d86-8d14-68bddbc0047f req-1c0450bf-f0a0-48c2-9f7c-f5389f1dabe9 service nova] Enqueued Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_rules [ 631.916358] env[65102]: INFO networking_nsxv3.common.synchronization [req-12ff576d-219d-4d86-8d14-68bddbc0047f req-1c0450bf-f0a0-48c2-9f7c-f5389f1dabe9 service nova] Enqueued Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_members [ 631.916488] env[65102]: INFO networking_nsxv3.common.synchronization [req-12ff576d-219d-4d86-8d14-68bddbc0047f req-1c0450bf-f0a0-48c2-9f7c-f5389f1dabe9 service nova] Enqueued Resource ID: 0b52bca6-ff8c-4322-9b18-1c1129186df6 with Priority: HIGHEST for action port [ 631.917198] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_rules [ 631.917360] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_members [ 631.917463] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b52bca6-ff8c-4322-9b18-1c1129186df6 with Priority: HIGHEST for action port [ 631.917762] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.917891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.917958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.918263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.918402] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.919389] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.919510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.919579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.919763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.919918] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.920051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.920148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.920265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.920368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.922310] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.922310] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b52bca6-ff8c-4322-9b18-1c1129186df6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.922310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b52bca6-ff8c-4322-9b18-1c1129186df6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.922310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b52bca6-ff8c-4322-9b18-1c1129186df6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.922310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b52bca6-ff8c-4322-9b18-1c1129186df6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.922310] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b52bca6-ff8c-4322-9b18-1c1129186df6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.943105] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.943105] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.943463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.943463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.943581] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.943581] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a is going to be created. [ 631.988994] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.989190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.989255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.989497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.991737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.011196] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a in Status: UNINITIALIZED for 2s [ 632.018656] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 632.018656] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.019229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.019454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.019572] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.423955] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.424117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.424337] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.427389] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b52bca6-ff8c-4322-9b18-1c1129186df6 with status ACTIVE [ 632.427389] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.427389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.427389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.427389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.427389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.427389] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.427389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.427389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.427389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.427389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.427389] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.427389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.427389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.427389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.427389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.427389] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b52bca6-ff8c-4322-9b18-1c1129186df6 is going to be updated. [ 632.452743] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.454420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.454773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.457377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.457478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.457614] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b52bca6-ff8c-4322-9b18-1c1129186df6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.520955] env[65102]: INFO networking_nsxv3.common.synchronization [req-347b3519-af5b-4732-8546-3508f3c4a7a2 req-c8b77535-1ad7-415d-a054-6443f0571384 service nova] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_rules [ 632.520955] env[65102]: INFO networking_nsxv3.common.synchronization [req-347b3519-af5b-4732-8546-3508f3c4a7a2 req-c8b77535-1ad7-415d-a054-6443f0571384 service nova] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 632.520955] env[65102]: INFO networking_nsxv3.common.synchronization [req-347b3519-af5b-4732-8546-3508f3c4a7a2 req-c8b77535-1ad7-415d-a054-6443f0571384 service nova] Enqueued Resource ID: d9b6f78e-710c-4b4c-a9bd-04632f29764a with Priority: HIGHEST for action port [ 632.521437] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_rules [ 632.521558] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 632.521638] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b6f78e-710c-4b4c-a9bd-04632f29764a with Priority: HIGHEST for action port [ 632.521941] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.522081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.522146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.522349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.522579] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.523164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.523164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.523164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.523164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.523411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.523446] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.525821] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.525821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.527145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.527145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.527145] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.530150] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.530554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.530667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.531312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.531440] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.531502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.531600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.531842] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.531953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.532160] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.533680] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9b6f78e-710c-4b4c-a9bd-04632f29764a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.533847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9b6f78e-710c-4b4c-a9bd-04632f29764a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.533925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9b6f78e-710c-4b4c-a9bd-04632f29764a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.534101] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9b6f78e-710c-4b4c-a9bd-04632f29764a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.534185] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9b6f78e-710c-4b4c-a9bd-04632f29764a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.900305] env[65102]: INFO networking_nsxv3.common.synchronization [req-351a9ca7-cd31-4f24-88d8-6cf08e54ac41 req-30aa56c9-ac07-4f78-9522-e1f7fe6d4002 tempest-ListImageFiltersTestJSON-812883063 tempest-ListImageFiltersTestJSON-812883063-project-member] Enqueued Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_members [ 632.901018] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_members [ 632.901423] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.901540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.930642] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.028054] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.028054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.028243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.028707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.028795] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.028958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.029089] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.029818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.029818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.029818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.030101] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.030294] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.031052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.031052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.031052] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.031419] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.031419] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.031603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.031603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.031763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.031903] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.034734] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.034901] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.036082] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.038829] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9b6f78e-710c-4b4c-a9bd-04632f29764a with status ACTIVE [ 633.039799] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.039799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.040711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.040711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.040820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.041121] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.042588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.043227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.043227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.043407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.043736] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.043885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.043885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.044090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.044216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.044382] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9b6f78e-710c-4b4c-a9bd-04632f29764a is going to be updated. [ 633.074219] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.074411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.074411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.074903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.074903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.074903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9b6f78e-710c-4b4c-a9bd-04632f29764a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.279085] env[65102]: INFO networking_nsxv3.common.synchronization [None req-73d89a7a-c3f2-473c-94ba-907dcea70ee4 None None] Enqueued Resource ID: b637a873-295f-4a2b-bb24-039ff32b69b6 with Priority: HIGHEST for action port [ 633.281808] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b637a873-295f-4a2b-bb24-039ff32b69b6 with Priority: HIGHEST for action port [ 633.282321] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b637a873-295f-4a2b-bb24-039ff32b69b6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.282494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b637a873-295f-4a2b-bb24-039ff32b69b6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.282595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b637a873-295f-4a2b-bb24-039ff32b69b6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.283082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b637a873-295f-4a2b-bb24-039ff32b69b6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.283082] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b637a873-295f-4a2b-bb24-039ff32b69b6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.337588] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.337789] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.337970] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.343270] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.343270] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.343270] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.343270] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.343270] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.343270] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.343270] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.343270] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.343270] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.343270] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.343270] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.343270] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.343270] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.367222] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.367477] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 633.367477] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.367639] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.367960] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-f9582d02-fbd0-490d-8f90-10bc9cf32af8 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.368149] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-f9582d02-fbd0-490d-8f90-10bc9cf32af8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.368265] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-f9582d02-fbd0-490d-8f90-10bc9cf32af8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.368583] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-f9582d02-fbd0-490d-8f90-10bc9cf32af8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.368719] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9582d02-fbd0-490d-8f90-10bc9cf32af8',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.433907] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.433907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.434107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.434211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.434346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.434404] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 is going to be created. [ 633.463781] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.464011] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.464011] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.464223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.464382] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.475135] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 in Status: UNINITIALIZED for 2s [ 633.535527] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1: rpc.has_security_group_logging(os_id): False [ 633.539933] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.553994] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.553994] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.553994] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.554277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.554277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.554480] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.554876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.554876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.554964] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.555071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.555291] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.555389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.555448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.555636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.555698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.556160] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.556160] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.556160] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.556325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.556363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.556444] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be updated. [ 633.639893] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.640107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.640107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.640397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.640548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.655182] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: IN_PROGRESS for 2s [ 633.785358] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b637a873-295f-4a2b-bb24-039ff32b69b6 [ 633.785601] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.785747] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.785819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.786068] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.786165] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.786263] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b637a873-295f-4a2b-bb24-039ff32b69b6 already deleted. [ 633.786364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b637a873-295f-4a2b-bb24-039ff32b69b6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.870914] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.871320] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.871320] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.871669] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.871807] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.872046] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port f9582d02-fbd0-490d-8f90-10bc9cf32af8 not found, creating... [ 633.873107] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.873107] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.873107] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.874239] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.874239] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.874239] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.874239] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.874239] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.874502] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.874639] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.874739] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: f9582d02-fbd0-490d-8f90-10bc9cf32af8 is going to be created. [ 633.897747] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.898050] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.898136] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.898374] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.898604] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.898860] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-f9582d02-fbd0-490d-8f90-10bc9cf32af8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.025106] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a in Status: SUCCESS [ 634.025506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.025667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.026029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.026319] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.026511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.026618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.026787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.026890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.026955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.027093] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.042441] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.042705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.042830] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.043166] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.043405] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.043506] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be created. [ 634.075953] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.076572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.076572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.076572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.076572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.086655] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: UNINITIALIZED for 2s [ 634.529606] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.651911] env[65102]: INFO networking_nsxv3.common.synchronization [req-351a9ca7-cd31-4f24-88d8-6cf08e54ac41 req-67ef1c1c-3873-41b7-a470-8c124a354736 service nova] Enqueued Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_rules [ 634.651911] env[65102]: INFO networking_nsxv3.common.synchronization [req-351a9ca7-cd31-4f24-88d8-6cf08e54ac41 req-67ef1c1c-3873-41b7-a470-8c124a354736 service nova] Enqueued Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_members [ 634.652090] env[65102]: INFO networking_nsxv3.common.synchronization [req-351a9ca7-cd31-4f24-88d8-6cf08e54ac41 req-67ef1c1c-3873-41b7-a470-8c124a354736 service nova] Enqueued Resource ID: f9582d02-fbd0-490d-8f90-10bc9cf32af8 with Priority: HIGHEST for action port [ 634.652685] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_rules [ 634.652733] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_members [ 634.652888] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9582d02-fbd0-490d-8f90-10bc9cf32af8 with Priority: HIGHEST for action port [ 634.655660] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.658218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.658218] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.658218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.658218] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9582d02-fbd0-490d-8f90-10bc9cf32af8 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.658218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9582d02-fbd0-490d-8f90-10bc9cf32af8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.658218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9582d02-fbd0-490d-8f90-10bc9cf32af8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.658218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9582d02-fbd0-490d-8f90-10bc9cf32af8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.658218] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9582d02-fbd0-490d-8f90-10bc9cf32af8',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.033686] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0bc7ffe-997e-4e93-849d-b293c0ee0e6a: rpc.has_security_group_logging(os_id): False [ 635.057891] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.061050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.061050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.061050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.061050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.061050] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.061050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.061050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.061050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.061050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.061050] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a is going to be created. [ 635.136356] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.136522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.136602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.136849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.137160] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.152993] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a in Status: IN_PROGRESS for 2s [ 635.159994] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9582d02-fbd0-490d-8f90-10bc9cf32af8 with status ACTIVE [ 635.161010] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.161178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.161550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.161687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.161777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.164242] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.164421] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.164482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.164749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.164860] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.165184] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.165359] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.165435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.165715] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.165859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.165989] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9582d02-fbd0-490d-8f90-10bc9cf32af8 is going to be updated. [ 635.196016] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.196360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.196360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.196584] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.196723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.196903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9582d02-fbd0-490d-8f90-10bc9cf32af8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.249860] env[65102]: INFO networking_nsxv3.common.synchronization [None req-3b8d2054-ff45-4603-9e74-dd4e010b8594 tempest-ServersTestJSON-86747762 tempest-ServersTestJSON-86747762-project-member] Enqueued Resource ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b with Priority: HIGHEST for action security_group_rules [ 635.252499] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b with Priority: HIGHEST for action security_group_rules [ 635.252912] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.253066] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.253135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.253413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.253499] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db36f333-73a7-4f6b-973f-e0c1b1ed809b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.428219] env[65102]: INFO networking_nsxv3.common.synchronization [None req-58ef9931-3be6-4096-a4a5-3f3467e3ce5b tempest-ServersTestJSON-86747762 tempest-ServersTestJSON-86747762-project-member] Enqueued Resource ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b with Priority: HIGHEST for action security_group_rules [ 635.428700] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b with Priority: HIGHEST for action security_group_rules [ 635.429762] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.429986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.491014] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 in Status: SUCCESS [ 635.491014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.491014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.491014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.491014] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.491014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.491014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.491014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.491014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.491014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.491014] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.491991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.492311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.492626] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.492898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.493099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.493407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.493642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.493858] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.557734] env[65102]: INFO networking_nsxv3.common.synchronization [None req-cef0b70f-56ff-4754-9bf7-c8ac6eba8880 tempest-ServersTestManualDisk-950056448 tempest-ServersTestManualDisk-950056448-project-member] Enqueued Resource ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d with Priority: HIGHEST for action security_group_rules [ 635.558569] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d with Priority: HIGHEST for action security_group_rules [ 635.558976] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.559126] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.559230] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.563028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.563028] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1e9f6d0-9fe0-49a8-a7c4-58871051f77d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.668018] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 635.668615] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.776347] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.776748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.776748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.776748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.776962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.776962] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b already deleted. [ 635.776962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.777180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.777423] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.777423] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db36f333-73a7-4f6b-973f-e0c1b1ed809b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.996918] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.997214] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.997290] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.083825] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.084354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.084354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.084354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.084354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.084662] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d already deleted. [ 636.084662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.100559] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 636.100559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.100559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.100559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.101069] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.101229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.101290] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.101710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.101710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.101710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.101834] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.200098] env[65102]: INFO networking_nsxv3.common.synchronization [None req-cf412989-98bd-42b6-884a-9634452c6db5 tempest-ServersTestManualDisk-950056448 tempest-ServersTestManualDisk-950056448-project-member] Enqueued Resource ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d with Priority: HIGHEST for action security_group_rules [ 636.200674] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d with Priority: HIGHEST for action security_group_rules [ 636.201023] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.201122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.201178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.201572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.201774] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1e9f6d0-9fe0-49a8-a7c4-58871051f77d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.298663] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.298905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.298995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.299639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.299639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.299639] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b already deleted. [ 636.299639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.501152] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.605526] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.605700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.605785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.606856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.606856] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.606856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.606856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.606856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.606856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.606856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.606856] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.607329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.607329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.607329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.607329] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.607329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.607517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.607517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.607582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.608061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.608061] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.727820] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.727977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.728042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.728257] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.728379] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.728426] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d already deleted. [ 636.728510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.004763] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.005162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.006607] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.006607] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.006607] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.006607] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 is going to be updated. [ 637.056379] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.056626] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.056626] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.057216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.057448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.070992] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 in Status: IN_PROGRESS for 2s [ 637.112665] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99c8f96e-2cdb-49cd-8847-bf7698ff539f: rpc.has_security_group_logging(os_id): False [ 637.137877] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.138363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.138572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.138792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.138895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.139159] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.139267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.139372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.139472] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.139588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.139882] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.139975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.140096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.140241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.140323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.140504] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.140647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.140647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.141440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.141838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.141838] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be created. [ 637.166539] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a in Status: SUCCESS [ 637.166803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.171607] env[65102]: INFO networking_nsxv3.common.synchronization [req-9991a720-83bc-4436-aa47-e042da250ab7 req-08e8a28e-e452-44ea-845a-291a75ff53f0 tempest-ServerDiagnosticsNegativeTest-1730136242 tempest-ServerDiagnosticsNegativeTest-1730136242-project-member] Enqueued Resource ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 with Priority: HIGHEST for action security_group_members [ 637.172313] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 with Priority: HIGHEST for action security_group_members [ 637.172662] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.172852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.172971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.173436] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.173675] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.173919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.174541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.174541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.174541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.174541] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9ff44a-eecd-47a3-a497-f84ebc9294a5',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.231617] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.231617] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.231617] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.232252] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.232252] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.247873] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 637.681189] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.681442] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.683660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.683978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.684097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.684331] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.684494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.684844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.684844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.685028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.685066] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 is going to be updated. [ 637.726030] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.726189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.726315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.726572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.726777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.738884] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 in Status: IN_PROGRESS for 2s [ 639.084941] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 in Status: SUCCESS [ 639.085603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.085603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.086334] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.086334] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.086334] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.086604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.087307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.087307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.087307] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.093902] env[65102]: INFO networking_nsxv3.common.synchronization [req-86422c16-34f3-4f3b-92ad-8f8d3aa0cdfa req-49407240-bba3-476b-8283-e101c3902237 tempest-ServersAdminTestJSON-1629823880 tempest-ServersAdminTestJSON-1629823880-project-member] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 639.094973] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 639.095438] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.095438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.095568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.095902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.096139] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.096139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.096139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.097019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.097109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.097259] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.267234] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 639.267482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.591701] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.600474] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.634726] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-552 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.634935] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.635100] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.635395] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.635692] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.635863] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.635980] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.636241] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.636483] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.636706] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.636816] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.636984] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.637118] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.637228] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.637330] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.637459] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.660320] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.660544] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.660635] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.660888] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.661237] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-321da8b7-0ae1-438d-816f-6c711ef9b003 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.661534] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-321da8b7-0ae1-438d-816f-6c711ef9b003" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.661534] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-321da8b7-0ae1-438d-816f-6c711ef9b003" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.661811] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-321da8b7-0ae1-438d-816f-6c711ef9b003" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.661949] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('321da8b7-0ae1-438d-816f-6c711ef9b003',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.751285] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 in Status: SUCCESS [ 639.751490] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 deletion is rescheduled due to dependency. [ 639.751616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.094217] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.105020] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.164726] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.165099] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.165274] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.165685] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.165887] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.166101] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 321da8b7-0ae1-438d-816f-6c711ef9b003 not found, creating... [ 640.166431] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.166611] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.166730] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.166963] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.167157] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.167454] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.167627] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.167751] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.167988] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.168143] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.168282] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 321da8b7-0ae1-438d-816f-6c711ef9b003 is going to be created. [ 640.196081] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.196357] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.196485] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.196898] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.197194] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.197448] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-321da8b7-0ae1-438d-816f-6c711ef9b003" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.600148] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.600347] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.600403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.600598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.600739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.600888] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 is going to be updated. [ 640.611067] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.611271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.611316] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.611534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.611626] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.611726] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be updated. [ 640.635815] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.635815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.635815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.635815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.635815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.649020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.649020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.649020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.649020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.649020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.649020] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 in Status: IN_PROGRESS for 2s [ 640.656954] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 640.946703] env[65102]: INFO networking_nsxv3.common.synchronization [req-86422c16-34f3-4f3b-92ad-8f8d3aa0cdfa req-61eadde2-fb0e-4f8b-95b7-e6c4904c455a service nova] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_rules [ 640.946952] env[65102]: INFO networking_nsxv3.common.synchronization [req-86422c16-34f3-4f3b-92ad-8f8d3aa0cdfa req-61eadde2-fb0e-4f8b-95b7-e6c4904c455a service nova] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 640.947133] env[65102]: INFO networking_nsxv3.common.synchronization [req-86422c16-34f3-4f3b-92ad-8f8d3aa0cdfa req-61eadde2-fb0e-4f8b-95b7-e6c4904c455a service nova] Enqueued Resource ID: 321da8b7-0ae1-438d-816f-6c711ef9b003 with Priority: HIGHEST for action port [ 640.947733] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_rules [ 640.947876] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 640.947977] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 321da8b7-0ae1-438d-816f-6c711ef9b003 with Priority: HIGHEST for action port [ 640.954285] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.954285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.954285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.954285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.954285] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.954970] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.955199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.955553] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-321da8b7-0ae1-438d-816f-6c711ef9b003 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.955714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-321da8b7-0ae1-438d-816f-6c711ef9b003" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.956632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-321da8b7-0ae1-438d-816f-6c711ef9b003" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.957064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-321da8b7-0ae1-438d-816f-6c711ef9b003" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.957064] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('321da8b7-0ae1-438d-816f-6c711ef9b003',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.463020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.463020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.463020] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 321da8b7-0ae1-438d-816f-6c711ef9b003 with status ACTIVE [ 641.463020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.463020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.463020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.463020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.463707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.463707] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.463707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.463707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.464036] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.464189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.464417] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.464570] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.464691] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.464910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.466492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.466492] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 321da8b7-0ae1-438d-816f-6c711ef9b003 is going to be updated. [ 641.496307] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.496519] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.496599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.496887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.497199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.497443] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-321da8b7-0ae1-438d-816f-6c711ef9b003" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.606069] env[65102]: INFO networking_nsxv3.common.synchronization [None req-b4d9c201-4d53-4de5-8d07-e8e3d5a7a55a None None] Enqueued Resource ID: 41bed50c-b7d0-4315-b800-f9ec42533382 with Priority: HIGHEST for action port [ 641.606463] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41bed50c-b7d0-4315-b800-f9ec42533382 with Priority: HIGHEST for action port [ 641.606893] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-41bed50c-b7d0-4315-b800-f9ec42533382 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.606976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41bed50c-b7d0-4315-b800-f9ec42533382" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.607030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41bed50c-b7d0-4315-b800-f9ec42533382" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.608232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41bed50c-b7d0-4315-b800-f9ec42533382" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.608402] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41bed50c-b7d0-4315-b800-f9ec42533382',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.110460] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41bed50c-b7d0-4315-b800-f9ec42533382 [ 642.110788] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.111182] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.111300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.111592] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.111754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.111887] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41bed50c-b7d0-4315-b800-f9ec42533382 already deleted. [ 642.112034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41bed50c-b7d0-4315-b800-f9ec42533382" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.286593] env[65102]: INFO networking_nsxv3.common.synchronization [req-73544a2b-217e-4439-ace0-b02bf75a56fa req-78a04b60-7e6e-4aa0-b0e0-af84568cb7d5 tempest-AttachInterfacesUnderV243Test-1550338923 tempest-AttachInterfacesUnderV243Test-1550338923-project-member] Enqueued Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_members [ 642.287605] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_members [ 642.287605] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4d20b00-9518-4813-be00-1234d826f6c1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.287605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.287898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.287952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.289194] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.289194] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.289194] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.289194] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.289194] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.289194] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.660681] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 in Status: SUCCESS [ 642.661205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.661400] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.661638] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.661853] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.661992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.662079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.662413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.662413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.662413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.662652] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.662652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.662793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.662974] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.663104] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.663225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.663550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.663550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.663550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.663808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.663808] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.666286] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 642.666472] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.666629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.666800] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.666958] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.667078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.667147] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.667288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.667362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.667461] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.795777] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.795777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.795777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.795777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.795777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.795777] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.795777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.795777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.795777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.795777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.795777] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4d20b00-9518-4813-be00-1234d826f6c1 already deleted. [ 642.795777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.828073] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-912 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.828361] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-912" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.828450] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-912" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.828744] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-912" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.829041] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.829215] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.829320] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.829535] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.829713] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.829868] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.830017] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.832320] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.832392] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.832463] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.832569] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.832703] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.855402] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.855717] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 642.856306] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.856616] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-912" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.857067] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.857284] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.857460] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.857829] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.858064] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa708f72-f0b6-4ac5-a002-0d6589e8ab0e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.166487] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1: rpc.has_security_group_logging(os_id): False [ 643.170603] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.192054] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.192270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.192340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.192865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.192865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.193677] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.193677] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.193677] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.193677] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.193677] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.193956] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.193956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.194056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.194216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.194295] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.194589] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.194737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.194798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.194959] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.195070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.195143] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 is going to be created. [ 643.279425] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.279425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.279425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.279425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.279964] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.292519] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 in Status: IN_PROGRESS for 2s [ 643.361390] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.361818] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.362086] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.363837] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.363837] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.363837] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port fa708f72-f0b6-4ac5-a002-0d6589e8ab0e not found, creating... [ 643.363837] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.364295] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.364295] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.364741] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.364873] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.365507] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.367671] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.367876] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.368261] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.368469] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.368703] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: fa708f72-f0b6-4ac5-a002-0d6589e8ab0e is going to be created. [ 643.401541] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.401873] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.402104] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.402510] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.402920] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.403971] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.672998] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.151472] env[65102]: INFO networking_nsxv3.common.synchronization [req-73544a2b-217e-4439-ace0-b02bf75a56fa req-e2f1402b-06a7-42c9-8aa5-a6d290e94617 service nova] Enqueued Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_rules [ 644.151472] env[65102]: INFO networking_nsxv3.common.synchronization [req-73544a2b-217e-4439-ace0-b02bf75a56fa req-e2f1402b-06a7-42c9-8aa5-a6d290e94617 service nova] Enqueued Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_members [ 644.151472] env[65102]: INFO networking_nsxv3.common.synchronization [req-73544a2b-217e-4439-ace0-b02bf75a56fa req-e2f1402b-06a7-42c9-8aa5-a6d290e94617 service nova] Enqueued Resource ID: fa708f72-f0b6-4ac5-a002-0d6589e8ab0e with Priority: HIGHEST for action port [ 644.151947] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_rules [ 644.152101] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_members [ 644.152325] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa708f72-f0b6-4ac5-a002-0d6589e8ab0e with Priority: HIGHEST for action port [ 644.152472] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4d20b00-9518-4813-be00-1234d826f6c1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.152672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.152672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.152885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.152963] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.154193] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4d20b00-9518-4813-be00-1234d826f6c1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.154403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.154516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.154918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.155126] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.155266] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.155364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.155568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.155773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.155857] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.156772] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.156983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.157133] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.157345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.157472] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa708f72-f0b6-4ac5-a002-0d6589e8ab0e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.176144] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.177051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.177051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.177308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.177812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.177977] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be updated. [ 644.211396] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.211619] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.211754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.211953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.212153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.223852] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 644.408797] env[65102]: INFO networking_nsxv3.common.synchronization [None req-f885fc84-f88f-44ce-9170-ceeab70187e4 None None] Enqueued Resource ID: 20857da6-b9d4-48b9-8446-7931f78e3373 with Priority: HIGHEST for action port [ 644.409073] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20857da6-b9d4-48b9-8446-7931f78e3373 with Priority: HIGHEST for action port [ 644.409629] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-20857da6-b9d4-48b9-8446-7931f78e3373 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.409761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20857da6-b9d4-48b9-8446-7931f78e3373" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.409830] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20857da6-b9d4-48b9-8446-7931f78e3373" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.413611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20857da6-b9d4-48b9-8446-7931f78e3373" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.413611] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20857da6-b9d4-48b9-8446-7931f78e3373',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.659042] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.660139] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4d20b00-9518-4813-be00-1234d826f6c1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.660307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.660445] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa708f72-f0b6-4ac5-a002-0d6589e8ab0e with status ACTIVE [ 644.660626] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.660785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.660785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.661016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.661109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.661281] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.661392] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.661447] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.661631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.661711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.661886] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.662021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.663810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.664074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.664111] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.664207] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa708f72-f0b6-4ac5-a002-0d6589e8ab0e is going to be updated. [ 644.687820] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.687820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.687820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.687820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.688668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.688668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.915921] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20857da6-b9d4-48b9-8446-7931f78e3373 [ 644.916222] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.916420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.916420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.916692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.916744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.916838] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20857da6-b9d4-48b9-8446-7931f78e3373 already deleted. [ 644.916921] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20857da6-b9d4-48b9-8446-7931f78e3373" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.166145] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.322407] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 in Status: SUCCESS [ 645.322643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.322828] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.323196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.323303] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.584379] env[65102]: INFO networking_nsxv3.common.synchronization [req-8753e28b-c25b-409e-b693-180ca8e79fcd req-0503d2bf-353c-4da0-bc4f-28e588fa09c4 tempest-MultipleCreateTestJSON-827681759 tempest-MultipleCreateTestJSON-827681759-project-member] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 645.585221] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 645.585546] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.585672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.585732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.585937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.586628] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.586745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.586814] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.586989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.587100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.587200] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.673681] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.673829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.673906] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.674273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.674387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.678023] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4d20b00-9518-4813-be00-1234d826f6c1 is going to be created. [ 645.692626] env[65102]: INFO networking_nsxv3.common.synchronization [req-aa876657-77ac-43e2-a80d-c4e062c715b6 req-32cf1b35-7a09-49d5-a5e2-a84bdd570b4b tempest-ServerMetadataNegativeTestJSON-921490363 tempest-ServerMetadataNegativeTestJSON-921490363-project-member] Enqueued Resource ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c with Priority: HIGHEST for action security_group_members [ 645.694435] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c with Priority: HIGHEST for action security_group_members [ 645.694863] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.695064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.695121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.695530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.695603] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.695686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.695745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.695941] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.696054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.696157] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a0d050a-9ee7-4daf-868e-6fdb6987f84c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.699206] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.699336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.699394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.699567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.699724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.710757] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4d20b00-9518-4813-be00-1234d826f6c1 in Status: UNINITIALIZED for 2s [ 645.826319] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.827739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.827739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.827739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.827739] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.827739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.827739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.827739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.827739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.827739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.827739] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.093034] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.180742] env[65102]: INFO networking_nsxv3.common.synchronization [None req-3aebfcd7-fe05-42a1-85fb-958f97243024 None None] Enqueued Resource ID: e718f8cc-3530-4ee1-ba5c-14272c8d5d67 with Priority: HIGHEST for action port [ 646.181387] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e718f8cc-3530-4ee1-ba5c-14272c8d5d67 with Priority: HIGHEST for action port [ 646.181717] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-e718f8cc-3530-4ee1-ba5c-14272c8d5d67 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.181877] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e718f8cc-3530-4ee1-ba5c-14272c8d5d67" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.181923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e718f8cc-3530-4ee1-ba5c-14272c8d5d67" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.183098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e718f8cc-3530-4ee1-ba5c-14272c8d5d67" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.183200] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e718f8cc-3530-4ee1-ba5c-14272c8d5d67',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.186751] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.186943] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-644" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.187169] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-644" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.187377] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-644" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.187729] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.187950] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.188117] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.188579] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.188656] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.188921] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.189127] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.189299] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.189445] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.189592] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.189735] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.189890] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.203026] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.203026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.203026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.203026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.203026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.203348] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.203348] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.203430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.203700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.203837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.203975] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c already deleted. [ 646.204131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.213245] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.213438] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 646.213685] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.213786] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-644" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.214098] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-2275d82f-e805-4c7b-8656-ff9475e7f524 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.214277] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-2275d82f-e805-4c7b-8656-ff9475e7f524" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.214382] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-2275d82f-e805-4c7b-8656-ff9475e7f524" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.214699] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-2275d82f-e805-4c7b-8656-ff9475e7f524" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.215149] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2275d82f-e805-4c7b-8656-ff9475e7f524',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.238272] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 646.238272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.238272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.238272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.238272] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.238272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.238272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.238272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.238272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.238272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.238272] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.333280] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.333280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.333280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.333280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.333280] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.333280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.333280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.333280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.333280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.334248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.334248] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.334248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.334248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.334248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.334248] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.334248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.334248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.334567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.334567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.334567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.334567] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.595458] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.691977] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e718f8cc-3530-4ee1-ba5c-14272c8d5d67 [ 646.692362] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.692566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.692672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.692981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.693035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.693425] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e718f8cc-3530-4ee1-ba5c-14272c8d5d67 already deleted. [ 646.693425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e718f8cc-3530-4ee1-ba5c-14272c8d5d67" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.717610] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.717839] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.717958] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.718346] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.718506] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.718655] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 2275d82f-e805-4c7b-8656-ff9475e7f524 not found, creating... [ 646.718985] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.719296] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.719296] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.719544] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.719683] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.719966] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.720136] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.720244] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.720541] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.720645] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.720799] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 2275d82f-e805-4c7b-8656-ff9475e7f524 is going to be created. [ 646.740031] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.740031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.740209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.740374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.740562] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.740716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.740828] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.741051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.741175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.741286] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.741436] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.741768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.741768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.742285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.742285] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.742285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.742285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.742536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.742536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.742536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.742629] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.746189] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.746189] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.746189] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.746189] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.746189] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.746189] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-2275d82f-e805-4c7b-8656-ff9475e7f524" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.838058] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1: rpc.has_security_group_logging(os_id): False [ 646.859591] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.859834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.859887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.860176] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.860442] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.860648] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.860856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.860962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.861190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.861280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.861496] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.861616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.861723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.861923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.862015] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.862221] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.862347] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.862478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.862662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.862773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.862977] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 is going to be updated. [ 646.949386] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.949625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.949739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.950089] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.950929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.965650] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 in Status: IN_PROGRESS for 2s [ 647.098559] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.098559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.098800] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.098800] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.099062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.099062] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be updated. [ 647.137096] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.137096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.137096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.137096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.137096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.150372] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: IN_PROGRESS for 2s [ 647.250800] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6a41d40-0a8b-401c-801a-f31f69ae007f: rpc.has_security_group_logging(os_id): False [ 647.273248] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.273248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.273248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.273248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.273553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.273785] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.273957] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.274118] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.274569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.274748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.275175] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.275331] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.275452] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.275886] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.276092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.276545] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.276728] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.276851] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.277073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.277220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.277359] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be updated. [ 647.366597] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.366843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.366927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.367173] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.367382] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.384067] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 647.524496] env[65102]: INFO networking_nsxv3.common.synchronization [req-aa876657-77ac-43e2-a80d-c4e062c715b6 req-e00a5156-3482-4a91-802f-1b12e2a5496c service nova] Enqueued Resource ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c with Priority: HIGHEST for action security_group_rules [ 647.524496] env[65102]: INFO networking_nsxv3.common.synchronization [req-aa876657-77ac-43e2-a80d-c4e062c715b6 req-e00a5156-3482-4a91-802f-1b12e2a5496c service nova] Enqueued Resource ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c with Priority: HIGHEST for action security_group_members [ 647.524496] env[65102]: INFO networking_nsxv3.common.synchronization [req-aa876657-77ac-43e2-a80d-c4e062c715b6 req-e00a5156-3482-4a91-802f-1b12e2a5496c service nova] Enqueued Resource ID: 2275d82f-e805-4c7b-8656-ff9475e7f524 with Priority: HIGHEST for action port [ 647.525284] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c with Priority: HIGHEST for action security_group_rules [ 647.525284] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c with Priority: HIGHEST for action security_group_members [ 647.529098] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2275d82f-e805-4c7b-8656-ff9475e7f524 with Priority: HIGHEST for action port [ 647.529098] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a0d050a-9ee7-4daf-868e-6fdb6987f84c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.529098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.529098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.529098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.529098] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a0d050a-9ee7-4daf-868e-6fdb6987f84c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.529098] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.529098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.529098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.529098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.529098] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.529098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.529098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.537337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.537337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.537337] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a0d050a-9ee7-4daf-868e-6fdb6987f84c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.537337] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-2275d82f-e805-4c7b-8656-ff9475e7f524 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.537337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2275d82f-e805-4c7b-8656-ff9475e7f524" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.537337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2275d82f-e805-4c7b-8656-ff9475e7f524" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.537337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2275d82f-e805-4c7b-8656-ff9475e7f524" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.537337] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2275d82f-e805-4c7b-8656-ff9475e7f524',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.724213] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4d20b00-9518-4813-be00-1234d826f6c1 in Status: SUCCESS [ 647.724633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.724895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.724895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.725666] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.725666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.725666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.725666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.725666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.725854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.725854] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.041168] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.041380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.042704] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a0d050a-9ee7-4daf-868e-6fdb6987f84c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.042704] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2275d82f-e805-4c7b-8656-ff9475e7f524 with status ACTIVE [ 648.042815] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.043038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.044654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.044654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.044654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.044654] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.044654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.044654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.044654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.044654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.047529] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.047529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.047529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.047529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.047529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.047821] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2275d82f-e805-4c7b-8656-ff9475e7f524 is going to be updated. [ 648.075486] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.075633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.075789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.075922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.076061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.076231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2275d82f-e805-4c7b-8656-ff9475e7f524" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.228965] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.549777] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a0d050a-9ee7-4daf-868e-6fdb6987f84c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.732439] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4d20b00-9518-4813-be00-1234d826f6c1: rpc.has_security_group_logging(os_id): False [ 648.756022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.756022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.756022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.756022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.756022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.756022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.756022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.756022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.756022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.756022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.756022] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4d20b00-9518-4813-be00-1234d826f6c1 is going to be created. [ 648.826505] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.826505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.826505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.826505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.826505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.838595] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4d20b00-9518-4813-be00-1234d826f6c1 in Status: IN_PROGRESS for 2s [ 648.984791] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 in Status: SUCCESS [ 648.985114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.054219] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.054451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.054451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.055086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.055278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.055398] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c is going to be created. [ 649.086407] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.087097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.087097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.087405] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.087575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.100357] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c in Status: UNINITIALIZED for 2s [ 649.164108] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 649.164431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.184629] env[65102]: INFO networking_nsxv3.common.synchronization [None req-961f16bd-2411-4195-998f-a0fc0d9d0b2f None None] Enqueued Resource ID: 7926c0dc-b384-4c63-abb1-3ee7c76df424 with Priority: HIGHEST for action port [ 649.184780] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7926c0dc-b384-4c63-abb1-3ee7c76df424 with Priority: HIGHEST for action port [ 649.185833] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-7926c0dc-b384-4c63-abb1-3ee7c76df424 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.186025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7926c0dc-b384-4c63-abb1-3ee7c76df424" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.186106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7926c0dc-b384-4c63-abb1-3ee7c76df424" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.186468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7926c0dc-b384-4c63-abb1-3ee7c76df424" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.186746] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7926c0dc-b384-4c63-abb1-3ee7c76df424',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.402360] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 649.402360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.689693] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7926c0dc-b384-4c63-abb1-3ee7c76df424 [ 649.689900] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.689900] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.690116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.690178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.690288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.690368] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7926c0dc-b384-4c63-abb1-3ee7c76df424 already deleted. [ 649.690503] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7926c0dc-b384-4c63-abb1-3ee7c76df424" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.532337] env[65102]: INFO networking_nsxv3.common.synchronization [req-638c68c2-ab62-4539-a7d3-4154857eb5d9 req-7e3cadd3-d001-4a3d-86f8-0df17cba4663 tempest-ServersTestJSON-86747762 tempest-ServersTestJSON-86747762-project-member] Enqueued Resource ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b with Priority: HIGHEST for action security_group_members [ 650.533156] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b with Priority: HIGHEST for action security_group_members [ 650.533436] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-db36f333-73a7-4f6b-973f-e0c1b1ed809b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.534586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.534586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.534586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.534586] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.534586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.534586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.534586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.534586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.534586] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db36f333-73a7-4f6b-973f-e0c1b1ed809b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.854635] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4d20b00-9518-4813-be00-1234d826f6c1 in Status: SUCCESS [ 650.854921] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.994343] env[65102]: INFO networking_nsxv3.common.synchronization [req-b48fad38-d371-436e-99ab-81cc59ee0f21 req-65565011-c006-4d27-8e84-118e9feea433 tempest-MultipleCreateTestJSON-827681759 tempest-MultipleCreateTestJSON-827681759-project-member] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 650.995096] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 650.995448] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.995578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.995648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.995867] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.998512] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.998668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.998717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.998922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.999030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.999137] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.038338] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.038497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.038566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.039640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.039640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.039640] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.039640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.039640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.039640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.039640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.039640] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b already deleted. [ 651.039640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.111996] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c in Status: SUCCESS [ 651.112150] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.112339] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.112572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.112769] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.112898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.113027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.113196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.113281] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.113385] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.113478] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a0d050a-9ee7-4daf-868e-6fdb6987f84c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.390236] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-637 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.390432] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-637" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.390547] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-637" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.390876] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-637" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.391167] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.391332] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.391476] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.391689] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.391804] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.392009] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.392122] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.392226] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.392328] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.392429] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.392544] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.392663] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.429935] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.430125] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 651.430178] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.430356] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-637" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.430746] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-8226470b-4e4b-4b3f-b40f-b29d3149af69 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.430995] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-8226470b-4e4b-4b3f-b40f-b29d3149af69" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.431116] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-8226470b-4e4b-4b3f-b40f-b29d3149af69" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.431407] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-8226470b-4e4b-4b3f-b40f-b29d3149af69" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.431558] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8226470b-4e4b-4b3f-b40f-b29d3149af69',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.501460] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.501659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.501734] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.501980] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.502134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.502274] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.502393] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.502454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.502837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.502837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.502837] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be updated. [ 651.575119] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.575556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.575556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.575556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.575820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.591140] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: IN_PROGRESS for 2s [ 651.619473] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.619855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.619855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.620171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.620171] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.620401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.620401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.620613] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.620613] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.620788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.620788] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.621035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.621035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.621229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.621377] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.621495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.621571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.621705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.621789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.621869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.621964] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a0d050a-9ee7-4daf-868e-6fdb6987f84c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.933666] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.933956] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.934059] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.935372] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.935372] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.935372] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 8226470b-4e4b-4b3f-b40f-b29d3149af69 not found, creating... [ 651.935372] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.935372] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.935372] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.935372] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.935727] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.935763] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.936049] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.936049] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.936235] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.936423] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.936526] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 8226470b-4e4b-4b3f-b40f-b29d3149af69 is going to be created. [ 651.964334] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.964567] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.964567] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.964746] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.965069] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.965209] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-8226470b-4e4b-4b3f-b40f-b29d3149af69" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.126753] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a0d050a-9ee7-4daf-868e-6fdb6987f84c: rpc.has_security_group_logging(os_id): False [ 652.172522] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.172728] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.172775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.173678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.173678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.173678] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.173678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.174053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.174053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.174140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.174314] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.174427] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.174495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.174659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.174835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.175360] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.175360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.175360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.175360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.175360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.175552] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c is going to be created. [ 652.311841] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.311998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.312075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.312365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.312561] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.325988] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c in Status: IN_PROGRESS for 2s [ 652.665172] env[65102]: INFO networking_nsxv3.common.synchronization [req-638c68c2-ab62-4539-a7d3-4154857eb5d9 req-5a22c3a7-a533-41f5-9a68-e736ede09637 service nova] Enqueued Resource ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b with Priority: HIGHEST for action security_group_rules [ 652.665172] env[65102]: INFO networking_nsxv3.common.synchronization [req-638c68c2-ab62-4539-a7d3-4154857eb5d9 req-5a22c3a7-a533-41f5-9a68-e736ede09637 service nova] Enqueued Resource ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b with Priority: HIGHEST for action security_group_members [ 652.665172] env[65102]: INFO networking_nsxv3.common.synchronization [req-638c68c2-ab62-4539-a7d3-4154857eb5d9 req-5a22c3a7-a533-41f5-9a68-e736ede09637 service nova] Enqueued Resource ID: 8226470b-4e4b-4b3f-b40f-b29d3149af69 with Priority: HIGHEST for action port [ 652.666480] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b with Priority: HIGHEST for action security_group_rules [ 652.666690] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b with Priority: HIGHEST for action security_group_members [ 652.666820] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8226470b-4e4b-4b3f-b40f-b29d3149af69 with Priority: HIGHEST for action port [ 652.667711] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.667711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.667711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.667711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.668082] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db36f333-73a7-4f6b-973f-e0c1b1ed809b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.672433] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-db36f333-73a7-4f6b-973f-e0c1b1ed809b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.672433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.672433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.672433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.672433] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.672433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.672433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.672433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.672433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.672433] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db36f333-73a7-4f6b-973f-e0c1b1ed809b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.673130] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-8226470b-4e4b-4b3f-b40f-b29d3149af69 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.673199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8226470b-4e4b-4b3f-b40f-b29d3149af69" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.673199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8226470b-4e4b-4b3f-b40f-b29d3149af69" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.674275] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8226470b-4e4b-4b3f-b40f-b29d3149af69" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.674275] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8226470b-4e4b-4b3f-b40f-b29d3149af69',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.177045] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-db36f333-73a7-4f6b-973f-e0c1b1ed809b taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.177045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.177045] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8226470b-4e4b-4b3f-b40f-b29d3149af69 with status ACTIVE [ 653.177045] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.177045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.177045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.177045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.177045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.177045] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.177045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.177045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.177776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.177776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.178292] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.178292] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.178526] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.178585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.178635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.178732] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8226470b-4e4b-4b3f-b40f-b29d3149af69 is going to be updated. [ 653.179938] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db36f333-73a7-4f6b-973f-e0c1b1ed809b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.214343] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.215060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.215060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.215060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.215060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.215338] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8226470b-4e4b-4b3f-b40f-b29d3149af69" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.524218] env[65102]: INFO networking_nsxv3.common.synchronization [req-f08d38d2-a358-48fd-a399-6234643be16f req-b8518c43-db19-4a51-b074-98ad54fe76f7 tempest-InstanceActionsTestJSON-1305569336 tempest-InstanceActionsTestJSON-1305569336-project-member] Enqueued Resource ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 with Priority: HIGHEST for action security_group_members [ 653.527446] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 with Priority: HIGHEST for action security_group_members [ 653.527446] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b26f4e0-5f0f-411f-8e44-f73309220261 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.527446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.527446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.527446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.527446] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.527446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.527446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.527446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.527446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.527446] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b26f4e0-5f0f-411f-8e44-f73309220261',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.602578] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 653.602785] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 deletion is rescheduled due to dependency. [ 653.602908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.684133] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db36f333-73a7-4f6b-973f-e0c1b1ed809b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.872117] env[65102]: INFO networking_nsxv3.common.synchronization [None req-6f0a5ea4-f995-4b7f-9605-0dc828635e89 None None] Enqueued Resource ID: 5ecd485a-c02e-4c38-8d53-26747ab0d756 with Priority: HIGHEST for action port [ 653.872888] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ecd485a-c02e-4c38-8d53-26747ab0d756 with Priority: HIGHEST for action port [ 653.873377] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ecd485a-c02e-4c38-8d53-26747ab0d756 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.873534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ecd485a-c02e-4c38-8d53-26747ab0d756" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.873664] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ecd485a-c02e-4c38-8d53-26747ab0d756" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.873892] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ecd485a-c02e-4c38-8d53-26747ab0d756" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.874059] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ecd485a-c02e-4c38-8d53-26747ab0d756',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.029755] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.033670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.033670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.033670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.033670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.033670] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.033670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.033670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.033670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.033670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.033670] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 is going to be updated. [ 654.067158] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.067424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.067424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.067858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.068018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.078471] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 in Status: IN_PROGRESS for 2s [ 654.187034] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.187325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.187325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.187565] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.187681] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.187949] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b is going to be created. [ 654.226924] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.227345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.227345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.227576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.227810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.238952] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b in Status: UNINITIALIZED for 2s [ 654.341651] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c in Status: SUCCESS [ 654.341941] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.377461] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ecd485a-c02e-4c38-8d53-26747ab0d756 [ 654.377693] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.377826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.378464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.378464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.378464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.378464] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ecd485a-c02e-4c38-8d53-26747ab0d756 already deleted. [ 654.378464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ecd485a-c02e-4c38-8d53-26747ab0d756" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.589495] env[65102]: INFO networking_nsxv3.common.synchronization [req-4d1fbc1a-6f36-47d0-8d5a-8232bc1cb370 req-e6458c15-2380-4ac2-97c6-4ab723e0336a tempest-DeleteServersTestJSON-1773899535 tempest-DeleteServersTestJSON-1773899535-project-member] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 654.590218] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 654.592076] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.592076] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.593724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.594641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.594641] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.594641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.594641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.594641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.594641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.595042] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.949345] env[65102]: INFO networking_nsxv3.common.synchronization [req-7a9dff8d-92be-49df-bf5b-9f80c83c55d0 req-f7028e83-fe6e-4bb4-a529-9391f6b3baa2 tempest-DeleteServersAdminTestJSON-453173968 tempest-DeleteServersAdminTestJSON-453173968-project-member] Enqueued Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_members [ 654.953664] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_members [ 654.954225] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.954225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.954337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.954486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.954640] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.954740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.954803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.954958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.955061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.955160] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.994536] env[65102]: INFO networking_nsxv3.common.synchronization [None req-16b8a2d3-acc3-4de6-ae17-60dbd37abfd9 None None] Enqueued Resource ID: b52548d8-88f3-49c3-a12a-05c28aa1988a with Priority: HIGHEST for action port [ 654.994811] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b52548d8-88f3-49c3-a12a-05c28aa1988a with Priority: HIGHEST for action port [ 654.995233] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b52548d8-88f3-49c3-a12a-05c28aa1988a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.995233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b52548d8-88f3-49c3-a12a-05c28aa1988a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.995330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b52548d8-88f3-49c3-a12a-05c28aa1988a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.995657] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b52548d8-88f3-49c3-a12a-05c28aa1988a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.995746] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b52548d8-88f3-49c3-a12a-05c28aa1988a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.102202] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.102202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.102202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.102202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.102202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.102202] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.102202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.102202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.102202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.102202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.102202] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 655.138331] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.138559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.139044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.139289] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.139460] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.148960] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 655.458554] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.458713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.458784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.459855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.459855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.459855] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.459855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.459855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.459855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.459855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.460170] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a is going to be updated. [ 655.497441] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.497747] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.497747] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.498472] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.498472] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.504674] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b52548d8-88f3-49c3-a12a-05c28aa1988a [ 655.504907] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.505042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.505110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.505312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.505396] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.505490] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b52548d8-88f3-49c3-a12a-05c28aa1988a already deleted. [ 655.505569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b52548d8-88f3-49c3-a12a-05c28aa1988a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.511180] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a in Status: IN_PROGRESS for 2s [ 655.595202] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.595202] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.595202] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.595202] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.595202] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.598299] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.598706] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.599055] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.599321] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.599648] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.600030] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.601356] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.601602] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.601832] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.602013] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.602214] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.623573] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.624885] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 655.625380] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.625990] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.626407] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.626701] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.626990] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.627974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.627974] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.089330] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 in Status: SUCCESS [ 656.089691] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 deletion is rescheduled due to dependency. [ 656.089691] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.130102] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.130350] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.130468] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.130759] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.130905] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.131073] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff not found, creating... [ 656.131430] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.131586] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.132112] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.132345] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.132753] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.133107] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.133343] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.133411] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.133613] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.133747] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.133885] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff is going to be created. [ 656.157293] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.157293] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.157293] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.157293] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.157600] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.157713] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.252065] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b in Status: SUCCESS [ 656.252262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.254758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.254758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.254758] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.254758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.254758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.254758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.254758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.254758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.254758] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db36f333-73a7-4f6b-973f-e0c1b1ed809b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.256687] env[65102]: INFO networking_nsxv3.common.synchronization [None req-8f73e137-6f7b-4e72-8e93-008f10688bed None None] Enqueued Resource ID: cf86de0b-b087-46b0-b039-0a6ca22d3c14 with Priority: HIGHEST for action port [ 656.257164] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf86de0b-b087-46b0-b039-0a6ca22d3c14 with Priority: HIGHEST for action port [ 656.257743] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf86de0b-b087-46b0-b039-0a6ca22d3c14 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.257883] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf86de0b-b087-46b0-b039-0a6ca22d3c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.257953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf86de0b-b087-46b0-b039-0a6ca22d3c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.260852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf86de0b-b087-46b0-b039-0a6ca22d3c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.260950] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf86de0b-b087-46b0-b039-0a6ca22d3c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.757897] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db36f333-73a7-4f6b-973f-e0c1b1ed809b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.764810] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf86de0b-b087-46b0-b039-0a6ca22d3c14 [ 656.765066] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.765356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.765356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.765533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.765630] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.765747] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf86de0b-b087-46b0-b039-0a6ca22d3c14 already deleted. [ 656.765986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf86de0b-b087-46b0-b039-0a6ca22d3c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.879117] env[65102]: INFO networking_nsxv3.common.synchronization [req-7a9dff8d-92be-49df-bf5b-9f80c83c55d0 req-73f4bff4-31fa-4930-ab6b-37e736661bbe service nova] Enqueued Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_rules [ 656.879117] env[65102]: INFO networking_nsxv3.common.synchronization [req-7a9dff8d-92be-49df-bf5b-9f80c83c55d0 req-73f4bff4-31fa-4930-ab6b-37e736661bbe service nova] Enqueued Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_members [ 656.879117] env[65102]: INFO networking_nsxv3.common.synchronization [req-7a9dff8d-92be-49df-bf5b-9f80c83c55d0 req-73f4bff4-31fa-4930-ab6b-37e736661bbe service nova] Enqueued Resource ID: d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff with Priority: HIGHEST for action port [ 656.879117] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_rules [ 656.879117] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_members [ 656.879117] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff with Priority: HIGHEST for action port [ 656.879117] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.879117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.879117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.879117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.879117] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.880370] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.881518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.881518] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.881518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.881518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.881518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.881518] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.903631] env[65102]: INFO networking_nsxv3.common.synchronization [None req-528300ea-5697-474c-b82d-5d78ad6bd4e3 None None] Enqueued Resource ID: 616c93e8-65b1-45bc-b144-1300325da81b with Priority: HIGHEST for action port [ 656.905051] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 616c93e8-65b1-45bc-b144-1300325da81b with Priority: HIGHEST for action port [ 656.905460] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-616c93e8-65b1-45bc-b144-1300325da81b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.905633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-616c93e8-65b1-45bc-b144-1300325da81b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.905862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-616c93e8-65b1-45bc-b144-1300325da81b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.906260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-616c93e8-65b1-45bc-b144-1300325da81b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.906403] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('616c93e8-65b1-45bc-b144-1300325da81b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.159922] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 657.160265] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f deletion is rescheduled due to dependency. [ 657.160265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.260596] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db36f333-73a7-4f6b-973f-e0c1b1ed809b: rpc.has_security_group_logging(os_id): False [ 657.280754] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.281733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.281733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.282231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.282405] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.282614] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.282722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.282787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.282961] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.283119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.283211] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b is going to be created. [ 657.325802] env[65102]: INFO networking_nsxv3.common.synchronization [req-645e231b-ec58-454b-be84-4c4a1681a2d3 req-123d36d2-9dad-4734-a608-ccfead904109 tempest-ServersTestManualDisk-950056448 tempest-ServersTestManualDisk-950056448-project-member] Enqueued Resource ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d with Priority: HIGHEST for action security_group_members [ 657.326750] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d with Priority: HIGHEST for action security_group_members [ 657.327420] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.329135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.329135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.329135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.329135] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.329135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.329135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.329690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.329690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.329690] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1e9f6d0-9fe0-49a8-a7c4-58871051f77d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.367029] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.367029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.367029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.367029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.367029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.378831] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b in Status: IN_PROGRESS for 2s [ 657.383994] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.384167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.387899] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff with status ACTIVE [ 657.387899] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.388118] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.388118] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.388595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.388595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.388595] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.388766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.388766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.388898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.388949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.389111] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.389201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.389262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.389399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.389615] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.389615] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff is going to be updated. [ 657.409519] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 616c93e8-65b1-45bc-b144-1300325da81b [ 657.409774] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.409990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.410093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.410632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.410632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.410632] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:616c93e8-65b1-45bc-b144-1300325da81b already deleted. [ 657.410821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-616c93e8-65b1-45bc-b144-1300325da81b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.415824] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.416101] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.416101] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.416365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.416490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.416601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d533dd9c-4bb6-4f96-b6fb-84bd5623a8ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.528911] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a in Status: SUCCESS [ 657.528911] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a deletion is rescheduled due to dependency. [ 657.528911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.528911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.528911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.528911] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.528911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.528911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.528911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.528911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.528911] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.833021] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.833315] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-834" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.833439] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-834" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.833805] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-834" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.834187] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.836118] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.836118] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.836118] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.836118] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.836118] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.836118] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.836118] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.836118] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.836118] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.836118] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.836118] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.837166] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.837269] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.837343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.837555] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.838743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.840340] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.840340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.840340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.840340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.840562] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.840562] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d already deleted. [ 657.840562] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.859370] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.859710] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.860527] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.861618] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-834" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.861618] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-55102692-2502-4633-b00b-cc29760fb310 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.861618] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-55102692-2502-4633-b00b-cc29760fb310" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.861618] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-55102692-2502-4633-b00b-cc29760fb310" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.862722] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-55102692-2502-4633-b00b-cc29760fb310" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.862722] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55102692-2502-4633-b00b-cc29760fb310',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.032419] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.365713] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.366095] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.366095] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.366447] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.366623] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.366757] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 55102692-2502-4633-b00b-cc29760fb310 not found, creating... [ 658.367440] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.367440] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.367440] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.367684] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.367809] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.368151] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.368344] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.368524] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.368628] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.368752] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.369537] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 55102692-2502-4633-b00b-cc29760fb310 is going to be created. [ 658.403927] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.404324] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.404559] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.404872] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.405192] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.405796] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-55102692-2502-4633-b00b-cc29760fb310" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.534476] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.038018] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.038018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.038018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.038018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.038018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.038018] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a is going to be updated. [ 659.068325] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.068510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.068599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.068863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.069322] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.078375] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a in Status: IN_PROGRESS for 2s [ 659.126500] env[65102]: INFO networking_nsxv3.common.synchronization [req-645e231b-ec58-454b-be84-4c4a1681a2d3 req-da0a6c40-9d02-4160-a4f0-b053ae8a3bac service nova] Enqueued Resource ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d with Priority: HIGHEST for action security_group_rules [ 659.126681] env[65102]: INFO networking_nsxv3.common.synchronization [req-645e231b-ec58-454b-be84-4c4a1681a2d3 req-da0a6c40-9d02-4160-a4f0-b053ae8a3bac service nova] Enqueued Resource ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d with Priority: HIGHEST for action security_group_members [ 659.126812] env[65102]: INFO networking_nsxv3.common.synchronization [req-645e231b-ec58-454b-be84-4c4a1681a2d3 req-da0a6c40-9d02-4160-a4f0-b053ae8a3bac service nova] Enqueued Resource ID: 55102692-2502-4633-b00b-cc29760fb310 with Priority: HIGHEST for action port [ 659.127415] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d with Priority: HIGHEST for action security_group_rules [ 659.127620] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d with Priority: HIGHEST for action security_group_members [ 659.127982] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55102692-2502-4633-b00b-cc29760fb310 with Priority: HIGHEST for action port [ 659.128482] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.128669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.128808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.129058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.129147] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1e9f6d0-9fe0-49a8-a7c4-58871051f77d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.130312] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.130435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.130504] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.130677] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.130894] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.130950] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.131255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.131443] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.131542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.131636] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1e9f6d0-9fe0-49a8-a7c4-58871051f77d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.132575] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-55102692-2502-4633-b00b-cc29760fb310 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.132575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55102692-2502-4633-b00b-cc29760fb310" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.132771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55102692-2502-4633-b00b-cc29760fb310" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.132771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55102692-2502-4633-b00b-cc29760fb310" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.132938] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55102692-2502-4633-b00b-cc29760fb310',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.390608] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b in Status: SUCCESS [ 659.390608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.634721] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.634870] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.635071] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1e9f6d0-9fe0-49a8-a7c4-58871051f77d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.638071] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55102692-2502-4633-b00b-cc29760fb310 with status ACTIVE [ 659.638071] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.638071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.638071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.638071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.638071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.638071] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.638071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.638071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.638071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.638071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.638071] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.638071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.638071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.638071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.638071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.638071] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55102692-2502-4633-b00b-cc29760fb310 is going to be updated. [ 659.670041] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.670241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.670287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.670467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.670600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.670754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55102692-2502-4633-b00b-cc29760fb310" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.142044] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1e9f6d0-9fe0-49a8-a7c4-58871051f77d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.196811] env[65102]: INFO networking_nsxv3.common.synchronization [None req-5ab02eb0-d60e-4a09-8a6b-6c0d5525fce0 tempest-ServerActionsTestOtherB-1046242315 tempest-ServerActionsTestOtherB-1046242315-project-member] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_rules [ 660.203873] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_rules [ 660.203873] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.203873] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.204040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.204934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.204934] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.506239] env[65102]: INFO networking_nsxv3.common.synchronization [None req-a4a90d6c-114a-46cc-a1e3-6b0b7a5189c2 None None] Enqueued Resource ID: 8fa4ce6a-a3d3-4bd1-9ac6-e8263ca85bc2 with Priority: HIGHEST for action port [ 660.506239] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fa4ce6a-a3d3-4bd1-9ac6-e8263ca85bc2 with Priority: HIGHEST for action port [ 660.506239] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fa4ce6a-a3d3-4bd1-9ac6-e8263ca85bc2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.506239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fa4ce6a-a3d3-4bd1-9ac6-e8263ca85bc2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.506239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fa4ce6a-a3d3-4bd1-9ac6-e8263ca85bc2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.506239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fa4ce6a-a3d3-4bd1-9ac6-e8263ca85bc2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.507029] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fa4ce6a-a3d3-4bd1-9ac6-e8263ca85bc2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.649919] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.650204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.650279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.650521] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.650577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.650683] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d is going to be created. [ 660.676221] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.676414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.676472] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.676650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.676810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.687431] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d in Status: UNINITIALIZED for 2s [ 660.726663] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.726906] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.727013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.727297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.727431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.727537] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 already deleted. [ 660.727629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.952439] env[65102]: INFO networking_nsxv3.common.synchronization [None req-5eda72c5-6aa9-4615-bb72-88de29874b4a tempest-ServerActionsTestOtherB-1046242315 tempest-ServerActionsTestOtherB-1046242315-project-member] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_rules [ 660.953020] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_rules [ 660.953379] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.953509] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.953579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.953855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.953929] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.009658] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fa4ce6a-a3d3-4bd1-9ac6-e8263ca85bc2 [ 661.010861] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.011138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.011227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.011477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.011583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.011698] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fa4ce6a-a3d3-4bd1-9ac6-e8263ca85bc2 already deleted. [ 661.011788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fa4ce6a-a3d3-4bd1-9ac6-e8263ca85bc2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.090201] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a in Status: SUCCESS [ 661.090201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.090356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.091029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.091029] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.091029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.091029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.091292] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.091983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.094045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.094045] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.476834] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.476999] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.477204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.477416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.477528] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.477633] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 already deleted. [ 661.477720] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.598546] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.598879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.598879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.599010] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.599212] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.599319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.599384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.599542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.599632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.601019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.601019] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.601019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.601019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.601019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.601019] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.601019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.601019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.601019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.601019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.601019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.601019] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.846274] env[65102]: INFO networking_nsxv3.common.synchronization [req-0d5a71d4-dc76-4811-bc86-45e3328ce759 req-ae6351e3-7427-4adb-b372-bf92a27aef21 tempest-ServersTestBootFromVolume-630499006 tempest-ServersTestBootFromVolume-630499006-project-member] Enqueued Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGHEST for action security_group_members [ 661.846853] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGHEST for action security_group_members [ 661.850698] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-14808516-a2e0-455d-83e1-fa5b5fe0e828 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.850698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.850698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.850698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.850698] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.850698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.850698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.850698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.850698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.850698] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14808516-a2e0-455d-83e1-fa5b5fe0e828',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.103655] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a: rpc.has_security_group_logging(os_id): False [ 662.125522] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.125681] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.125753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.125971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.126081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.126274] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.126401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.126465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.126765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.126765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.126963] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.127071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.127133] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.127330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.127373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.127529] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.127620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.127948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.127948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.127948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.127948] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a is going to be updated. [ 662.203350] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.203536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.203596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.203778] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.203964] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.226123] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a in Status: IN_PROGRESS for 2s [ 662.350641] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.350874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.350874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.351478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.351595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.351806] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.351928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.351991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.352178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.352323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.352382] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 already deleted. [ 662.352907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.462681] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-528 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.462920] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-528" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.462974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-528" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.463355] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-528" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.463626] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.463825] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.463887] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.464972] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.465381] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.465557] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.465785] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.466044] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.466225] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.466373] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.466641] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.466879] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.493686] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.493926] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 662.494121] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.494379] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-528" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.494860] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-09df7af1-1609-4648-a7d1-a870687d5bbb taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.495230] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-09df7af1-1609-4648-a7d1-a870687d5bbb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.495448] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-09df7af1-1609-4648-a7d1-a870687d5bbb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.495886] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-09df7af1-1609-4648-a7d1-a870687d5bbb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.496101] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09df7af1-1609-4648-a7d1-a870687d5bbb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.700962] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d in Status: SUCCESS [ 662.701329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.701643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.701879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.702134] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.702260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.702546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.702546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.702546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.702761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.702761] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1e9f6d0-9fe0-49a8-a7c4-58871051f77d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.001370] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.001507] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.002453] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.002453] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.002453] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.002453] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 09df7af1-1609-4648-a7d1-a870687d5bbb not found, creating... [ 663.002706] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.002838] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.002929] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.003220] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.003853] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.003853] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.004151] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.004151] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.004303] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.004430] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.005151] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 09df7af1-1609-4648-a7d1-a870687d5bbb is going to be created. [ 663.030913] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.031596] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.031875] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.032046] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.032316] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.035827] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-09df7af1-1609-4648-a7d1-a870687d5bbb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.206097] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1e9f6d0-9fe0-49a8-a7c4-58871051f77d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.223924] env[65102]: INFO networking_nsxv3.common.synchronization [req-34a9f6a4-7734-4e37-b868-8df174691786 req-9f953e26-ba46-4733-809b-5098e937e081 tempest-ImagesOneServerTestJSON-2092730972 tempest-ImagesOneServerTestJSON-2092730972-project-member] Enqueued Resource ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec with Priority: HIGHEST for action security_group_members [ 663.224988] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec with Priority: HIGHEST for action security_group_members [ 663.224988] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.225137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.225137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.225357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.225535] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.225632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.225706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.225847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.225932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.226043] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e67ea8b7-f278-4fbd-ba09-b18599f6e8ec',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.447307] env[65102]: INFO networking_nsxv3.common.synchronization [None req-79822ee3-ed9a-4d78-8318-e4fc760d3ad9 None None] Enqueued Resource ID: dc892896-1af6-4959-9681-e5da28762d75 with Priority: HIGHEST for action port [ 663.447846] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc892896-1af6-4959-9681-e5da28762d75 with Priority: HIGHEST for action port [ 663.448179] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc892896-1af6-4959-9681-e5da28762d75 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.448310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc892896-1af6-4959-9681-e5da28762d75" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.448377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc892896-1af6-4959-9681-e5da28762d75" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.448623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc892896-1af6-4959-9681-e5da28762d75" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.448709] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc892896-1af6-4959-9681-e5da28762d75',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.710106] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1e9f6d0-9fe0-49a8-a7c4-58871051f77d: rpc.has_security_group_logging(os_id): False [ 663.728791] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.729229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.729484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.729751] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.729898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.730634] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.730868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.731081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.731247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.731563] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.731775] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d is going to be created. [ 663.733650] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.733894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.733994] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.734204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.734304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.734503] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.734620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.734687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.734906] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.734968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.735121] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec already deleted. [ 663.735254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.744026] env[65102]: INFO networking_nsxv3.common.synchronization [req-0d5a71d4-dc76-4811-bc86-45e3328ce759 req-24c348a5-f787-43f7-97df-ba3d5edf1c5a service nova] Enqueued Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGHEST for action security_group_rules [ 663.744487] env[65102]: INFO networking_nsxv3.common.synchronization [req-0d5a71d4-dc76-4811-bc86-45e3328ce759 req-24c348a5-f787-43f7-97df-ba3d5edf1c5a service nova] Enqueued Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGHEST for action security_group_members [ 663.744487] env[65102]: INFO networking_nsxv3.common.synchronization [req-0d5a71d4-dc76-4811-bc86-45e3328ce759 req-24c348a5-f787-43f7-97df-ba3d5edf1c5a service nova] Enqueued Resource ID: 09df7af1-1609-4648-a7d1-a870687d5bbb with Priority: HIGHEST for action port [ 663.745068] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGHEST for action security_group_rules [ 663.745314] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGHEST for action security_group_members [ 663.745525] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09df7af1-1609-4648-a7d1-a870687d5bbb with Priority: HIGHEST for action port [ 663.745980] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14808516-a2e0-455d-83e1-fa5b5fe0e828 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.745980] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.746131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.746364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.746480] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14808516-a2e0-455d-83e1-fa5b5fe0e828',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.747609] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-14808516-a2e0-455d-83e1-fa5b5fe0e828 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.748491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.748491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.748491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.748491] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.748491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.748491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.748491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.748491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.748874] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14808516-a2e0-455d-83e1-fa5b5fe0e828',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.750730] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-09df7af1-1609-4648-a7d1-a870687d5bbb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.750730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09df7af1-1609-4648-a7d1-a870687d5bbb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.750730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09df7af1-1609-4648-a7d1-a870687d5bbb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.750730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09df7af1-1609-4648-a7d1-a870687d5bbb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.750730] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09df7af1-1609-4648-a7d1-a870687d5bbb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.799010] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.799324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.799445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.799748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.800035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.812149] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d in Status: IN_PROGRESS for 2s [ 663.951604] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc892896-1af6-4959-9681-e5da28762d75 [ 663.952443] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.952872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.953196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.954157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.954507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.954748] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc892896-1af6-4959-9681-e5da28762d75 already deleted. [ 663.954990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc892896-1af6-4959-9681-e5da28762d75" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.956333] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.956523] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-877" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.956651] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-877" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.957576] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-877" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.958341] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.958777] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.959200] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.959763] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.960225] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.960717] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.961090] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.961448] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.961675] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.961971] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.962184] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.962429] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.990882] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.990882] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 663.990882] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.991232] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-877" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.991488] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-8a1e7b3c-e981-43b6-84a0-1adcd2b2a044 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.991703] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-8a1e7b3c-e981-43b6-84a0-1adcd2b2a044" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.991817] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-8a1e7b3c-e981-43b6-84a0-1adcd2b2a044" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.992173] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-8a1e7b3c-e981-43b6-84a0-1adcd2b2a044" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.992319] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a1e7b3c-e981-43b6-84a0-1adcd2b2a044',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.240105] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a in Status: SUCCESS [ 664.240105] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.254537] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-14808516-a2e0-455d-83e1-fa5b5fe0e828 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.254824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.254896] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14808516-a2e0-455d-83e1-fa5b5fe0e828',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.255841] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09df7af1-1609-4648-a7d1-a870687d5bbb with status ACTIVE [ 664.256067] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.256184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.256241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.257073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.257073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.257073] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.257073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.257073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.257073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.257073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.257469] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.257469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.257469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.257602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.257602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.257679] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09df7af1-1609-4648-a7d1-a870687d5bbb is going to be updated. [ 664.287416] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.287416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.287416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.287416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.287416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.287416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09df7af1-1609-4648-a7d1-a870687d5bbb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.499679] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.499679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.499679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.499679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.499679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.499679] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 8a1e7b3c-e981-43b6-84a0-1adcd2b2a044 not found, creating... [ 664.499679] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.499679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.499679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.499679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.499679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.500196] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.500196] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.500196] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.500196] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.500196] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.500467] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 8a1e7b3c-e981-43b6-84a0-1adcd2b2a044 is going to be created. [ 664.530090] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.530090] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.530090] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.530090] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.530090] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.530090] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-8a1e7b3c-e981-43b6-84a0-1adcd2b2a044" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.761508] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14808516-a2e0-455d-83e1-fa5b5fe0e828',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.264852] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.265315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.265315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.265474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.265474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.265996] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 is going to be created. [ 665.268429] env[65102]: INFO networking_nsxv3.common.synchronization [req-34a9f6a4-7734-4e37-b868-8df174691786 req-c1098df0-9d64-4e0a-9a75-b18bf26c01ee service nova] Enqueued Resource ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec with Priority: HIGHEST for action security_group_rules [ 665.268820] env[65102]: INFO networking_nsxv3.common.synchronization [req-34a9f6a4-7734-4e37-b868-8df174691786 req-c1098df0-9d64-4e0a-9a75-b18bf26c01ee service nova] Enqueued Resource ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec with Priority: HIGHEST for action security_group_members [ 665.268898] env[65102]: INFO networking_nsxv3.common.synchronization [req-34a9f6a4-7734-4e37-b868-8df174691786 req-c1098df0-9d64-4e0a-9a75-b18bf26c01ee service nova] Enqueued Resource ID: 8a1e7b3c-e981-43b6-84a0-1adcd2b2a044 with Priority: HIGHEST for action port [ 665.269686] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec with Priority: HIGHEST for action security_group_rules [ 665.276021] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec with Priority: HIGHEST for action security_group_members [ 665.276021] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1e7b3c-e981-43b6-84a0-1adcd2b2a044 with Priority: HIGHEST for action port [ 665.276021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.276021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.276021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.276021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.276021] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e67ea8b7-f278-4fbd-ba09-b18599f6e8ec',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.280452] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.280759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.281340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.281842] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.282687] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.284990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.284990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.284990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.284990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.284990] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e67ea8b7-f278-4fbd-ba09-b18599f6e8ec',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.284990] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a1e7b3c-e981-43b6-84a0-1adcd2b2a044 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.284990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a1e7b3c-e981-43b6-84a0-1adcd2b2a044" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.285531] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a1e7b3c-e981-43b6-84a0-1adcd2b2a044" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.285826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a1e7b3c-e981-43b6-84a0-1adcd2b2a044" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.286047] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a1e7b3c-e981-43b6-84a0-1adcd2b2a044',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.302538] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.302838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.303192] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.303449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.303449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.317107] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 in Status: UNINITIALIZED for 2s [ 665.777572] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.779899] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.789853] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e67ea8b7-f278-4fbd-ba09-b18599f6e8ec',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.789853] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a1e7b3c-e981-43b6-84a0-1adcd2b2a044 with status ACTIVE [ 665.789853] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.789853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.790945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.790945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.790945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.790945] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.790945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.790945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.790945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.790945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.792546] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.792546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.792546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.792739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.792841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.792958] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a1e7b3c-e981-43b6-84a0-1adcd2b2a044 is going to be updated. [ 665.819207] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.819441] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.819553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.819777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.820425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.820425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a1e7b3c-e981-43b6-84a0-1adcd2b2a044" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.832331] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d in Status: SUCCESS [ 665.832331] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.182864] env[65102]: INFO networking_nsxv3.common.synchronization [None req-f40c51d5-ca58-46ae-a60a-8c1b498998ca None None] Enqueued Resource ID: f2857954-05fe-4d7a-a4da-8c2838f63ec9 with Priority: HIGHEST for action port [ 666.183681] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2857954-05fe-4d7a-a4da-8c2838f63ec9 with Priority: HIGHEST for action port [ 666.186167] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2857954-05fe-4d7a-a4da-8c2838f63ec9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.186273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2857954-05fe-4d7a-a4da-8c2838f63ec9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.186448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2857954-05fe-4d7a-a4da-8c2838f63ec9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.186640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2857954-05fe-4d7a-a4da-8c2838f63ec9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.186741] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2857954-05fe-4d7a-a4da-8c2838f63ec9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.295985] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e67ea8b7-f278-4fbd-ba09-b18599f6e8ec',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.693904] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2857954-05fe-4d7a-a4da-8c2838f63ec9 [ 666.694251] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.694825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.694825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.694825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.695011] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.695178] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2857954-05fe-4d7a-a4da-8c2838f63ec9 already deleted. [ 666.696790] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2857954-05fe-4d7a-a4da-8c2838f63ec9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.800288] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.800288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.800288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.800735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.800789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.801381] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec is going to be created. [ 666.833756] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.833756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.833756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.833996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.833996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.852314] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec in Status: UNINITIALIZED for 2s [ 667.239320] env[65102]: INFO networking_nsxv3.common.synchronization [req-89be55af-4ccb-49e3-bf86-ccc7b9529fec req-a5818a7c-e419-485b-a9e5-5a52a25ee711 tempest-TenantUsagesTestJSON-55507538 tempest-TenantUsagesTestJSON-55507538-project-member] Enqueued Resource ID: 645542ed-d50b-43c7-9870-1006fec2c84f with Priority: HIGHEST for action security_group_members [ 667.243103] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645542ed-d50b-43c7-9870-1006fec2c84f with Priority: HIGHEST for action security_group_members [ 667.244038] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-645542ed-d50b-43c7-9870-1006fec2c84f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.244286] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.244286] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.244392] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.245240] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.247162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.247162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.247405] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.247498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.247605] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('645542ed-d50b-43c7-9870-1006fec2c84f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.332028] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 in Status: SUCCESS [ 667.332260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.332442] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.332775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.332875] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.333014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.333081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.333275] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.333358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.333447] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.333617] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14808516-a2e0-455d-83e1-fa5b5fe0e828',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.750879] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.751166] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.751304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.751484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.751581] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.751809] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.751936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.751992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.752123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.752203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.752294] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645542ed-d50b-43c7-9870-1006fec2c84f is going to be updated. [ 667.794867] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.795218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.795218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.795334] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.795500] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.808277] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645542ed-d50b-43c7-9870-1006fec2c84f in Status: IN_PROGRESS for 2s [ 667.836906] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14808516-a2e0-455d-83e1-fa5b5fe0e828',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.340707] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14808516-a2e0-455d-83e1-fa5b5fe0e828: rpc.has_security_group_logging(os_id): False [ 668.362390] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.362576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.362648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.362890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.362986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.363324] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.363467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.363528] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.363655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.363722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.363815] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 is going to be created. [ 668.411578] env[65102]: INFO networking_nsxv3.common.synchronization [None req-89480615-e541-47ba-b687-98c90ff4e25f tempest-ServerActionsV293TestJSON-238779998 tempest-ServerActionsV293TestJSON-238779998-project-member] Enqueued Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGHEST for action security_group_rules [ 668.412342] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGHEST for action security_group_rules [ 668.412657] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c61af5d-d112-491b-97cd-9e037a2e5189 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.412791] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.412863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.413688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.413688] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c61af5d-d112-491b-97cd-9e037a2e5189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.463684] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.463684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.463684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.463951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.464109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.482663] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 in Status: IN_PROGRESS for 2s [ 668.592708] env[65102]: INFO networking_nsxv3.common.synchronization [None req-844170b0-08e7-40be-868a-f4486b5e5ee9 tempest-ServerActionsV293TestJSON-238779998 tempest-ServerActionsV293TestJSON-238779998-project-member] Enqueued Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGHEST for action security_group_rules [ 668.593375] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGHEST for action security_group_rules [ 668.593698] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c61af5d-d112-491b-97cd-9e037a2e5189 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.593805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.866418] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec in Status: SUCCESS [ 668.866824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.866938] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.867221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.867337] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.867531] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.867610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.867809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.867896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.867989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.868108] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e67ea8b7-f278-4fbd-ba09-b18599f6e8ec',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.931140] env[65102]: INFO networking_nsxv3.common.synchronization [None req-90c7f766-457e-46f5-891a-dd9a4b114a01 None None] Enqueued Resource ID: af6046be-e692-4b71-88b3-ff6dd9627a30 with Priority: HIGHEST for action port [ 668.931253] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af6046be-e692-4b71-88b3-ff6dd9627a30 with Priority: HIGHEST for action port [ 668.931845] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-af6046be-e692-4b71-88b3-ff6dd9627a30 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.931845] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af6046be-e692-4b71-88b3-ff6dd9627a30" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.931845] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af6046be-e692-4b71-88b3-ff6dd9627a30" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.932117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af6046be-e692-4b71-88b3-ff6dd9627a30" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.932162] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af6046be-e692-4b71-88b3-ff6dd9627a30',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.937898] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.938064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.938129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.938462] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.938604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.938604] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 already deleted. [ 668.938733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.939281] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.939587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.939754] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c61af5d-d112-491b-97cd-9e037a2e5189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.372716] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.372716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.372716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.372716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.372716] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.372716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.372716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.372716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.372716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.372716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.373952] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.374121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.374189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.374358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.374511] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.374604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.374664] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.374808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.374897] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.375010] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.375120] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e67ea8b7-f278-4fbd-ba09-b18599f6e8ec',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.437733] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af6046be-e692-4b71-88b3-ff6dd9627a30 [ 669.437733] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.437733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.437935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.438026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.438123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.438224] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af6046be-e692-4b71-88b3-ff6dd9627a30 already deleted. [ 669.438312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af6046be-e692-4b71-88b3-ff6dd9627a30" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.464198] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.464319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.464378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.464599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.464685] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.464780] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 already deleted. [ 669.465073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.825232] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 645542ed-d50b-43c7-9870-1006fec2c84f in Status: SUCCESS [ 669.825232] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 645542ed-d50b-43c7-9870-1006fec2c84f deletion is rescheduled due to dependency. [ 669.825232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.879338] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e67ea8b7-f278-4fbd-ba09-b18599f6e8ec: rpc.has_security_group_logging(os_id): False [ 669.900683] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.900970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.900970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.901307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.901445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.901770] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.902050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.902153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.902390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.902504] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.902900] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.903174] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.903329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.903529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.903666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.904060] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.904272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.904365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.904556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.904668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.904802] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec is going to be created. [ 669.974773] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.974773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.975028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.975286] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.975412] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.990837] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec in Status: IN_PROGRESS for 2s [ 670.499136] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 in Status: SUCCESS [ 670.499387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.006952] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec in Status: SUCCESS [ 672.006952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.232081] env[65102]: INFO networking_nsxv3.common.synchronization [None req-15bcf6c2-b723-40fc-a713-afe9ed014d0f None None] Enqueued Resource ID: a726524b-ee3f-4b3a-b349-b95b8e1b0fdb with Priority: HIGHEST for action port [ 672.233114] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a726524b-ee3f-4b3a-b349-b95b8e1b0fdb with Priority: HIGHEST for action port [ 672.233536] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-a726524b-ee3f-4b3a-b349-b95b8e1b0fdb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.233938] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a726524b-ee3f-4b3a-b349-b95b8e1b0fdb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.234116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a726524b-ee3f-4b3a-b349-b95b8e1b0fdb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.235486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a726524b-ee3f-4b3a-b349-b95b8e1b0fdb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.235486] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a726524b-ee3f-4b3a-b349-b95b8e1b0fdb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.741376] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a726524b-ee3f-4b3a-b349-b95b8e1b0fdb [ 672.741376] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.742200] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.742393] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.742691] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.742869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.743239] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a726524b-ee3f-4b3a-b349-b95b8e1b0fdb already deleted. [ 672.743406] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a726524b-ee3f-4b3a-b349-b95b8e1b0fdb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.300992] env[65102]: INFO networking_nsxv3.common.synchronization [req-be6e114d-51ce-46a2-b50a-3a25984ee5d0 req-3c23049d-a165-4f56-8b60-0b9d6dd3ff14 tempest-ServersAdminTestJSON-1629823880 tempest-ServersAdminTestJSON-1629823880-project-member] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 674.302213] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 674.302213] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.302213] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.302213] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.302525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.307885] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.307885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.307885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.307885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.307885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.307885] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.412183] env[65102]: INFO networking_nsxv3.common.synchronization [None req-aa136e0e-2f3a-4cb8-a525-a9a76eed8722 None None] Enqueued Resource ID: 2f6b6edb-d150-42f4-9207-4e5342c076a2 with Priority: HIGHEST for action port [ 674.412183] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f6b6edb-d150-42f4-9207-4e5342c076a2 with Priority: HIGHEST for action port [ 674.412183] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f6b6edb-d150-42f4-9207-4e5342c076a2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.412183] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f6b6edb-d150-42f4-9207-4e5342c076a2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.412183] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f6b6edb-d150-42f4-9207-4e5342c076a2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.412526] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f6b6edb-d150-42f4-9207-4e5342c076a2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.412526] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f6b6edb-d150-42f4-9207-4e5342c076a2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.809551] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.914667] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f6b6edb-d150-42f4-9207-4e5342c076a2 [ 674.914955] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.915110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.915179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.915402] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.915491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.915590] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f6b6edb-d150-42f4-9207-4e5342c076a2 already deleted. [ 674.916052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f6b6edb-d150-42f4-9207-4e5342c076a2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.024589] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-552 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.024680] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.024810] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.025071] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.025394] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.025566] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.025647] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.025878] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.026000] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.026310] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.027146] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.027476] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.027476] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.027561] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.027598] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.028173] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.049798] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.050167] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.050167] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.050298] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-552" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.050639] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-8db11d31-614c-4e71-bb14-c5327b541437 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.050903] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-8db11d31-614c-4e71-bb14-c5327b541437" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.051080] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-8db11d31-614c-4e71-bb14-c5327b541437" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.051484] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-8db11d31-614c-4e71-bb14-c5327b541437" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.051865] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8db11d31-614c-4e71-bb14-c5327b541437',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.312728] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.556024] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.556024] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.556024] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.556024] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.556024] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.556024] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 8db11d31-614c-4e71-bb14-c5327b541437 not found, creating... [ 675.556024] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.556024] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.556024] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.556024] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.556598] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.556598] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.556598] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.556598] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.556786] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.556903] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.557667] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 8db11d31-614c-4e71-bb14-c5327b541437 is going to be created. [ 675.578720] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.578937] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.579071] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.579329] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.579562] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.579786] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-8db11d31-614c-4e71-bb14-c5327b541437" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.815804] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.816075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.816159] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.816471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.816619] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.816746] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be updated. [ 675.863026] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.863271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.863372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.863607] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.863754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.878534] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 676.357257] env[65102]: INFO networking_nsxv3.common.synchronization [req-be6e114d-51ce-46a2-b50a-3a25984ee5d0 req-70c63ea3-222d-46c6-ad76-d28c7bd1f2fc service nova] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_rules [ 676.357675] env[65102]: INFO networking_nsxv3.common.synchronization [req-be6e114d-51ce-46a2-b50a-3a25984ee5d0 req-70c63ea3-222d-46c6-ad76-d28c7bd1f2fc service nova] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 676.357675] env[65102]: INFO networking_nsxv3.common.synchronization [req-be6e114d-51ce-46a2-b50a-3a25984ee5d0 req-70c63ea3-222d-46c6-ad76-d28c7bd1f2fc service nova] Enqueued Resource ID: 8db11d31-614c-4e71-bb14-c5327b541437 with Priority: HIGHEST for action port [ 676.360356] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_rules [ 676.360356] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 676.360356] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8db11d31-614c-4e71-bb14-c5327b541437 with Priority: HIGHEST for action port [ 676.360356] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.360356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.360356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.360356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.360356] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.363951] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.363951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.363951] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-8db11d31-614c-4e71-bb14-c5327b541437 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.363951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8db11d31-614c-4e71-bb14-c5327b541437" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.363951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8db11d31-614c-4e71-bb14-c5327b541437" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.363951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8db11d31-614c-4e71-bb14-c5327b541437" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.363951] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8db11d31-614c-4e71-bb14-c5327b541437',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.865141] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.865304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.867559] env[65102]: INFO networking_nsxv3.common.synchronization [None req-b7fac21e-2119-4af2-b900-b07d4a31646f None None] Enqueued Resource ID: 9bcf7870-8005-48cd-887b-0d55ed02ff83 with Priority: HIGHEST for action port [ 676.868441] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bcf7870-8005-48cd-887b-0d55ed02ff83 with Priority: HIGHEST for action port [ 676.868635] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8db11d31-614c-4e71-bb14-c5327b541437 with status ACTIVE [ 676.869160] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.869285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.869356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.869569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.869665] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.869849] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.869972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.870708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.872797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.872797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.872797] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.872797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.873011] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.873684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.873684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.873684] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8db11d31-614c-4e71-bb14-c5327b541437 is going to be updated. [ 676.876113] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bcf7870-8005-48cd-887b-0d55ed02ff83 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.876250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bcf7870-8005-48cd-887b-0d55ed02ff83" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.876351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bcf7870-8005-48cd-887b-0d55ed02ff83" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.876604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bcf7870-8005-48cd-887b-0d55ed02ff83" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.876725] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bcf7870-8005-48cd-887b-0d55ed02ff83',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.901138] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.901138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.901138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.901471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.901471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.901847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8db11d31-614c-4e71-bb14-c5327b541437" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.383041] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bcf7870-8005-48cd-887b-0d55ed02ff83 [ 677.383041] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.383041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.383041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.383041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.383041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.383041] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bcf7870-8005-48cd-887b-0d55ed02ff83 already deleted. [ 677.383041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bcf7870-8005-48cd-887b-0d55ed02ff83" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.891779] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 677.891779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.891779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.891779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.891779] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.891779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.891779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.891779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.891779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.891779] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.395223] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.898707] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.218422] env[65102]: INFO networking_nsxv3.common.synchronization [req-a4ea1cbe-7618-4857-96b1-b0b08b5c4947 req-d4ec2ceb-4be7-49a7-a0b7-84ae86a7b49d tempest-DeleteServersAdminTestJSON-453173968 tempest-DeleteServersAdminTestJSON-453173968-project-member] Enqueued Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_members [ 679.219009] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGHEST for action security_group_members [ 679.219346] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.219612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.219612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.219725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.219880] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.220038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.220099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.220592] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.220592] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.220592] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.407770] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.407770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.408187] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.408187] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.408187] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.408317] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be updated. [ 679.442595] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.442595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.442595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.442595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.442595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.452674] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 679.562282] env[65102]: INFO networking_nsxv3.common.synchronization [None req-774ea8fc-4e48-4fa3-8af0-3cf36fa67d5a None None] Enqueued Resource ID: e6ec8da5-4a7f-4719-ac9c-2ac1b059960b with Priority: HIGHEST for action port [ 679.563446] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6ec8da5-4a7f-4719-ac9c-2ac1b059960b with Priority: HIGHEST for action port [ 679.563446] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6ec8da5-4a7f-4719-ac9c-2ac1b059960b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.563559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6ec8da5-4a7f-4719-ac9c-2ac1b059960b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.563559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6ec8da5-4a7f-4719-ac9c-2ac1b059960b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.564017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6ec8da5-4a7f-4719-ac9c-2ac1b059960b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.564017] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6ec8da5-4a7f-4719-ac9c-2ac1b059960b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.723902] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.724140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.724217] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.726620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.726620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.726620] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.726620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.726620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.726620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.726620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.726620] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a is going to be updated. [ 679.763256] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.763656] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.763656] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.763803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.763897] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.778252] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a in Status: IN_PROGRESS for 2s [ 680.066775] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6ec8da5-4a7f-4719-ac9c-2ac1b059960b [ 680.066775] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.066979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.066979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.067150] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.067853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.067853] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6ec8da5-4a7f-4719-ac9c-2ac1b059960b already deleted. [ 680.067853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6ec8da5-4a7f-4719-ac9c-2ac1b059960b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.466751] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 681.467143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.467505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.467505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.467595] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.467817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.467817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.468019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.468019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.468143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.468268] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.552071] env[65102]: INFO networking_nsxv3.common.synchronization [req-5dc21116-2ec8-4a41-8e2d-ba9b8bcde260 req-da32da5d-7e46-4709-982f-6af3e9cbea4d tempest-ServerRescueTestJSONUnderV235-1815693667 tempest-ServerRescueTestJSONUnderV235-1815693667-project-member] Enqueued Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_members [ 681.552071] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_members [ 681.552071] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.552071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.552071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.552071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.552071] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.553089] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.553351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.553880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.554141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.555181] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.790339] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a in Status: SUCCESS [ 681.790498] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a deletion is rescheduled due to dependency. [ 681.791423] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.973599] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.973765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.973838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.974803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.975085] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.975825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.975825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.975825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.975825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.975825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.976155] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.976155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.976155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.976312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.976517] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.976517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.976709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.976709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.976792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.976856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.976954] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.056424] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.056584] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.056655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.056865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.056975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.057269] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.057380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.057455] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.057676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.057947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.057947] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 already deleted. [ 682.057947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.103177] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-13 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.103425] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-13" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.103704] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-13" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.104176] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-13" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.104555] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.104689] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.104840] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.105189] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.105286] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.105479] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.105599] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.105696] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.105797] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.105902] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.106012] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.106142] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.142799] env[65102]: INFO networking_nsxv3.common.synchronization [None req-61a11998-e486-4847-8ffb-2f43eafa9059 None None] Enqueued Resource ID: da512ccd-f8a1-4422-b0e2-61cea89ea808 with Priority: HIGHEST for action port [ 682.143990] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.144615] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.144770] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.144945] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-13" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.145357] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-41ad83e5-4645-4e91-a223-473eefb69c38 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.145557] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.145686] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.147016] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.147169] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41ad83e5-4645-4e91-a223-473eefb69c38',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.148288] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da512ccd-f8a1-4422-b0e2-61cea89ea808 with Priority: HIGHEST for action port [ 682.148936] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-da512ccd-f8a1-4422-b0e2-61cea89ea808 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.148936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da512ccd-f8a1-4422-b0e2-61cea89ea808" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.149114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da512ccd-f8a1-4422-b0e2-61cea89ea808" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.151931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da512ccd-f8a1-4422-b0e2-61cea89ea808" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.152076] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da512ccd-f8a1-4422-b0e2-61cea89ea808',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.482994] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6a41d40-0a8b-401c-801a-f31f69ae007f: rpc.has_security_group_logging(os_id): False [ 682.502139] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.502373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.502415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.503203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.503203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.503203] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.503203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.503203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.503609] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.503609] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.503609] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.503829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.503829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.503899] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.503976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.504308] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.504426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.504594] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.504770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.504850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.504962] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be updated. [ 682.569522] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.572048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.572048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.572048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.572048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.597217] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 682.650690] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.650919] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.650919] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.653090] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.653090] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.653090] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 41ad83e5-4645-4e91-a223-473eefb69c38 not found, creating... [ 682.653090] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.653090] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.653090] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.653866] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.653866] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.653866] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.654149] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.654149] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.654328] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.655056] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.655056] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 41ad83e5-4645-4e91-a223-473eefb69c38 is going to be created. [ 682.655705] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da512ccd-f8a1-4422-b0e2-61cea89ea808 [ 682.655919] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.656060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.656126] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.656282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.656360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.656450] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da512ccd-f8a1-4422-b0e2-61cea89ea808 already deleted. [ 682.656571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da512ccd-f8a1-4422-b0e2-61cea89ea808" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.680333] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.680333] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.680333] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.680333] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.680879] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.680879] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.456059] env[65102]: INFO networking_nsxv3.common.synchronization [req-5dc21116-2ec8-4a41-8e2d-ba9b8bcde260 req-79f34141-a448-40cf-bd0a-fe269150683f service nova] Enqueued Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_rules [ 683.456059] env[65102]: INFO networking_nsxv3.common.synchronization [req-5dc21116-2ec8-4a41-8e2d-ba9b8bcde260 req-79f34141-a448-40cf-bd0a-fe269150683f service nova] Enqueued Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_members [ 683.456207] env[65102]: INFO networking_nsxv3.common.synchronization [req-5dc21116-2ec8-4a41-8e2d-ba9b8bcde260 req-79f34141-a448-40cf-bd0a-fe269150683f service nova] Enqueued Resource ID: 41ad83e5-4645-4e91-a223-473eefb69c38 with Priority: HIGHEST for action port [ 683.456718] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_rules [ 683.456855] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_members [ 683.456956] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ad83e5-4645-4e91-a223-473eefb69c38 with Priority: HIGHEST for action port [ 683.457509] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.457631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.458158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.460642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.460642] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.460642] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.460642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.460642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.460642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.460642] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.461225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.461225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.461225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.461225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.461225] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.462717] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-41ad83e5-4645-4e91-a223-473eefb69c38 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.462906] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.462906] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.463111] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.463207] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41ad83e5-4645-4e91-a223-473eefb69c38',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.961611] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.962078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.965422] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41ad83e5-4645-4e91-a223-473eefb69c38 with status ACTIVE [ 683.965702] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.965844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.965914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.966164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.966260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.966449] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.966599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.966675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.966846] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.966935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.971016] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.971016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.971016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.971016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.971016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.971016] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41ad83e5-4645-4e91-a223-473eefb69c38 is going to be updated. [ 683.971016] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.996034] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.996632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.996632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.996855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.997077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.997311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.475603] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.476322] env[65102]: INFO networking_nsxv3.common.synchronization [None req-e2eae460-8581-4858-a557-31106de4400f tempest-MigrationsAdminTest-673773847 tempest-MigrationsAdminTest-673773847-project-member] Enqueued Resource ID: 6fd35388-95ff-485d-b438-3a586ad7f38f with Priority: HIGHEST for action security_group_rules [ 684.476731] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd35388-95ff-485d-b438-3a586ad7f38f with Priority: HIGHEST for action security_group_rules [ 684.477924] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fd35388-95ff-485d-b438-3a586ad7f38f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.478160] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fd35388-95ff-485d-b438-3a586ad7f38f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.478393] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fd35388-95ff-485d-b438-3a586ad7f38f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.478651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fd35388-95ff-485d-b438-3a586ad7f38f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.478784] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fd35388-95ff-485d-b438-3a586ad7f38f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.583029] env[65102]: INFO networking_nsxv3.common.synchronization [None req-1e739abd-794b-456c-8171-14bfcad1e468 tempest-MigrationsAdminTest-673773847 tempest-MigrationsAdminTest-673773847-project-member] Enqueued Resource ID: 6fd35388-95ff-485d-b438-3a586ad7f38f with Priority: HIGHEST for action security_group_rules [ 684.583029] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd35388-95ff-485d-b438-3a586ad7f38f with Priority: HIGHEST for action security_group_rules [ 684.583029] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fd35388-95ff-485d-b438-3a586ad7f38f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.583029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fd35388-95ff-485d-b438-3a586ad7f38f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.614307] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 684.615826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.982698] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.983073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.983073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.983160] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.983198] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.984934] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 is going to be created. [ 685.004505] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.004667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.004774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.005080] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.005182] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.005284] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fd35388-95ff-485d-b438-3a586ad7f38f already deleted. [ 685.005368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fd35388-95ff-485d-b438-3a586ad7f38f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.005528] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fd35388-95ff-485d-b438-3a586ad7f38f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.005689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fd35388-95ff-485d-b438-3a586ad7f38f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.005772] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fd35388-95ff-485d-b438-3a586ad7f38f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.009910] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.010122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.010210] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.010388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.010646] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.021696] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: UNINITIALIZED for 2s [ 685.146801] env[65102]: INFO networking_nsxv3.common.synchronization [None req-298900dd-a2a1-48db-8622-93e5ba47c8f1 None None] Enqueued Resource ID: 04aa6d16-6d61-4a77-a0fd-e112e82e9824 with Priority: HIGHEST for action port [ 685.147093] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04aa6d16-6d61-4a77-a0fd-e112e82e9824 with Priority: HIGHEST for action port [ 685.147724] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-04aa6d16-6d61-4a77-a0fd-e112e82e9824 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.147724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04aa6d16-6d61-4a77-a0fd-e112e82e9824" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.147724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04aa6d16-6d61-4a77-a0fd-e112e82e9824" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.147968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04aa6d16-6d61-4a77-a0fd-e112e82e9824" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.147968] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04aa6d16-6d61-4a77-a0fd-e112e82e9824',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.533810] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.533810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.533810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.533810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.533810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.533810] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fd35388-95ff-485d-b438-3a586ad7f38f already deleted. [ 685.533810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fd35388-95ff-485d-b438-3a586ad7f38f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.655050] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04aa6d16-6d61-4a77-a0fd-e112e82e9824 [ 685.655326] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.655471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.655575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.658113] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.658242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.658363] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04aa6d16-6d61-4a77-a0fd-e112e82e9824 already deleted. [ 685.658479] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04aa6d16-6d61-4a77-a0fd-e112e82e9824" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.663628] env[65102]: INFO networking_nsxv3.common.synchronization [req-4c85d7b8-7249-4bf8-a167-5bf847e9b118 req-d88152ce-bda9-4e31-9bd7-8cc150cb2b48 tempest-ServerActionsTestOtherB-1046242315 tempest-ServerActionsTestOtherB-1046242315-project-member] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 685.664886] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 685.665212] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.665345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.665410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.665670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.665855] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.665985] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.666085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.666287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.666380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.666493] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.170514] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.170963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.170963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.171107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.171157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.171613] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.171613] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.171613] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.172952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.172952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.172952] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 already deleted. [ 686.172952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.178977] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.179192] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.179315] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.179659] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.179913] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.180107] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.180245] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.180575] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.180737] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.181480] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.184042] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.184042] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.184042] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.184042] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.184042] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.184042] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.204191] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.204281] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 686.204863] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.204863] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.205354] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-3d38d576-1871-49a5-bc10-aef1a37abfa0 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.205536] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-3d38d576-1871-49a5-bc10-aef1a37abfa0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.205536] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-3d38d576-1871-49a5-bc10-aef1a37abfa0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.206036] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-3d38d576-1871-49a5-bc10-aef1a37abfa0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.206036] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d38d576-1871-49a5-bc10-aef1a37abfa0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.710687] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.710902] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.711325] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.711325] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.711475] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.711715] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 3d38d576-1871-49a5-bc10-aef1a37abfa0 not found, creating... [ 686.712464] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.712464] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.712464] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.712933] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.712933] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.712933] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.713165] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.713232] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.713426] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.713609] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.713959] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 3d38d576-1871-49a5-bc10-aef1a37abfa0 is going to be created. [ 686.736811] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.737068] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.737536] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.737536] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.738102] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.738359] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-3d38d576-1871-49a5-bc10-aef1a37abfa0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.847387] env[65102]: INFO networking_nsxv3.common.synchronization [req-4aa95487-bd6a-4953-886c-2642f02aa176 req-f60d65de-ca2d-42f8-be85-94ff0896ae4d tempest-FloatingIPsAssociationNegativeTestJSON-1021891016 tempest-FloatingIPsAssociationNegativeTestJSON-1021891016-project-member] Enqueued Resource ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 with Priority: HIGHEST for action security_group_members [ 686.848563] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 with Priority: HIGHEST for action security_group_members [ 686.849681] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.850507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.851945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.851945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.851945] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.851945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.851945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.852216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.852216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.852298] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48a0698b-8c00-4295-9ba0-bc4c6ebdca57',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.032040] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: SUCCESS [ 687.032645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.034223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.034223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.034223] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.034223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.034223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.034223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.034223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.034223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.034223] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.359110] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.359487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.359487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.359634] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.359770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.361356] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.361356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.361356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.361356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.361356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.361356] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 is going to be updated. [ 687.403049] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.403335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.403335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.403468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.403592] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.416660] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 in Status: IN_PROGRESS for 2s [ 687.536604] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.536784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.536854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.537109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.537303] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.537406] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.537464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.537657] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.537749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.537853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.538043] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.538185] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.538297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.538451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.538812] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.538812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.538812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.538989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.538989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.539095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.539268] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.542627] env[65102]: INFO networking_nsxv3.common.synchronization [req-4c85d7b8-7249-4bf8-a167-5bf847e9b118 req-39328cbf-8ad5-432c-bda4-e7fff167eaad service nova] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_rules [ 687.543078] env[65102]: INFO networking_nsxv3.common.synchronization [req-4c85d7b8-7249-4bf8-a167-5bf847e9b118 req-39328cbf-8ad5-432c-bda4-e7fff167eaad service nova] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 687.543078] env[65102]: INFO networking_nsxv3.common.synchronization [req-4c85d7b8-7249-4bf8-a167-5bf847e9b118 req-39328cbf-8ad5-432c-bda4-e7fff167eaad service nova] Enqueued Resource ID: 3d38d576-1871-49a5-bc10-aef1a37abfa0 with Priority: HIGHEST for action port [ 687.543912] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_rules [ 687.544336] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 687.544483] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d38d576-1871-49a5-bc10-aef1a37abfa0 with Priority: HIGHEST for action port [ 687.544897] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.545062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.545133] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.545403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.545500] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.546520] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.546737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.546807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.546986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.547230] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.547355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.548012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.548012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.548012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.548237] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.550105] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d38d576-1871-49a5-bc10-aef1a37abfa0 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.550228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d38d576-1871-49a5-bc10-aef1a37abfa0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.550510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d38d576-1871-49a5-bc10-aef1a37abfa0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.550510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d38d576-1871-49a5-bc10-aef1a37abfa0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.550631] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d38d576-1871-49a5-bc10-aef1a37abfa0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.047281] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04d8d678-ef4e-4987-a57b-b8f1a69f0a59: rpc.has_security_group_logging(os_id): False [ 688.053840] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.053840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.054216] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.056937] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d38d576-1871-49a5-bc10-aef1a37abfa0 with status ACTIVE [ 688.056937] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.057125] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.057125] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.057388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.057908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.057908] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.057908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.057908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.058154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.061544] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.061544] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.061544] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.062241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.062512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.062827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.062973] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d38d576-1871-49a5-bc10-aef1a37abfa0 is going to be updated. [ 688.076430] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.076430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.076430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.076716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.076716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.077070] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.077179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.077262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.077503] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.078264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.078264] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.078264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.078264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.078521] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.078521] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.079074] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.079189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.079277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.079951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.079951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.079951] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 is going to be created. [ 688.105722] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.105722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.105722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.105722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.105722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.105722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d38d576-1871-49a5-bc10-aef1a37abfa0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.171956] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.171956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.171956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.171956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.171956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.203683] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: IN_PROGRESS for 2s [ 688.565239] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.067684] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.067852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.067923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.068196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.068327] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.068462] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be created. [ 689.096850] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.096996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.097077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.097335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.097494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.112114] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: UNINITIALIZED for 2s [ 689.427269] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 in Status: SUCCESS [ 689.427598] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48a0698b-8c00-4295-9ba0-bc4c6ebdca57 deletion is rescheduled due to dependency. [ 689.427717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48a0698b-8c00-4295-9ba0-bc4c6ebdca57" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.219827] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: SUCCESS [ 690.220103] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.126403] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 691.126403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.126403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.126403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.126403] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.126403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.126403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.126403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.127242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.127242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.127242] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.631414] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.693802] env[65102]: INFO networking_nsxv3.common.synchronization [None req-334688a3-3385-42b8-ae69-23efd9655c17 None None] Enqueued Resource ID: bf9159fb-3440-4379-a72b-7c6c528087d3 with Priority: HIGHEST for action port [ 691.696772] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf9159fb-3440-4379-a72b-7c6c528087d3 with Priority: HIGHEST for action port [ 691.701519] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf9159fb-3440-4379-a72b-7c6c528087d3 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.701519] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf9159fb-3440-4379-a72b-7c6c528087d3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.701519] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf9159fb-3440-4379-a72b-7c6c528087d3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.701519] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf9159fb-3440-4379-a72b-7c6c528087d3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.701519] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf9159fb-3440-4379-a72b-7c6c528087d3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.136440] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0212d5d1-3785-49e1-b4e8-aaad4f538d18: rpc.has_security_group_logging(os_id): False [ 692.164723] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.164841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.164934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.166358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.166358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.166358] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.166358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.166358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.166358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.166358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.166358] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be created. [ 692.204022] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf9159fb-3440-4379-a72b-7c6c528087d3 [ 692.204299] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.204435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.204641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.204782] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.204865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.204966] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf9159fb-3440-4379-a72b-7c6c528087d3 already deleted. [ 692.205122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf9159fb-3440-4379-a72b-7c6c528087d3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.291923] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.291923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.291923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.292492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.292578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.309442] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: IN_PROGRESS for 2s [ 693.461340] env[65102]: INFO networking_nsxv3.common.synchronization [req-836e1bff-0c30-48eb-8266-2cdedebb9ea8 req-e79c26f0-52ef-44c7-bd52-07878526f150 tempest-MultipleCreateTestJSON-827681759 tempest-MultipleCreateTestJSON-827681759-project-member] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 693.461340] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 693.461340] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.461340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.461340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.461340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.461340] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.461340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.461340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.461835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.461835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.461835] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.825174] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.825693] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.825820] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.826121] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.826391] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.826716] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.826894] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.827143] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.827287] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.827495] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.827604] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.827903] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.828059] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.828175] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.828277] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.828409] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.851027] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.851156] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 693.851298] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.851469] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.851786] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-232c23c9-ffb2-48f4-8094-39a295742f87 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.851939] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-232c23c9-ffb2-48f4-8094-39a295742f87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.852141] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-232c23c9-ffb2-48f4-8094-39a295742f87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.852394] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-232c23c9-ffb2-48f4-8094-39a295742f87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.853971] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('232c23c9-ffb2-48f4-8094-39a295742f87',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.963672] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.964409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.964409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.964409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.964409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.964775] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.964775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.964775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.964962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.965060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.965178] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be updated. [ 693.997122] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.997482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.997482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.997736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.997926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.007933] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: IN_PROGRESS for 2s [ 694.157600] env[65102]: INFO networking_nsxv3.common.synchronization [None req-6d07ebf5-a0a5-4636-beb6-0979a7117681 None None] Enqueued Resource ID: aa2545f0-3945-42e6-9657-c36d631c72eb with Priority: HIGHEST for action port [ 694.157600] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa2545f0-3945-42e6-9657-c36d631c72eb with Priority: HIGHEST for action port [ 694.157600] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa2545f0-3945-42e6-9657-c36d631c72eb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.157600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa2545f0-3945-42e6-9657-c36d631c72eb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.157600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa2545f0-3945-42e6-9657-c36d631c72eb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.157600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa2545f0-3945-42e6-9657-c36d631c72eb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.157600] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa2545f0-3945-42e6-9657-c36d631c72eb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.338189] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 694.338189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.356015] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.356324] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.356446] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.356719] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.356859] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.357024] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 232c23c9-ffb2-48f4-8094-39a295742f87 not found, creating... [ 694.357299] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.357738] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.357738] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.357902] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.357951] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.358613] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.359084] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.359084] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.359332] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.359664] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.359664] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 232c23c9-ffb2-48f4-8094-39a295742f87 is going to be created. [ 694.390920] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.390920] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.390920] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.390920] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.391220] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.391374] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-232c23c9-ffb2-48f4-8094-39a295742f87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.661677] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa2545f0-3945-42e6-9657-c36d631c72eb [ 694.661677] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.662053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.662053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.662151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.662252] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.662350] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa2545f0-3945-42e6-9657-c36d631c72eb already deleted. [ 694.662433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa2545f0-3945-42e6-9657-c36d631c72eb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.883896] env[65102]: INFO networking_nsxv3.common.synchronization [None req-9a43655e-0f2d-46d5-a21a-381c508207b2 None None] Enqueued Resource ID: 8e600993-6aa5-4e81-a0c7-37fe364b4e98 with Priority: HIGHEST for action port [ 694.885122] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e600993-6aa5-4e81-a0c7-37fe364b4e98 with Priority: HIGHEST for action port [ 694.885798] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e600993-6aa5-4e81-a0c7-37fe364b4e98 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.885952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e600993-6aa5-4e81-a0c7-37fe364b4e98" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.886548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e600993-6aa5-4e81-a0c7-37fe364b4e98" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.886548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e600993-6aa5-4e81-a0c7-37fe364b4e98" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.893330] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e600993-6aa5-4e81-a0c7-37fe364b4e98',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.159288] env[65102]: INFO networking_nsxv3.common.synchronization [req-836e1bff-0c30-48eb-8266-2cdedebb9ea8 req-8064cccb-f6f2-4292-b904-1c33e6dbc257 service nova] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_rules [ 695.159517] env[65102]: INFO networking_nsxv3.common.synchronization [req-836e1bff-0c30-48eb-8266-2cdedebb9ea8 req-8064cccb-f6f2-4292-b904-1c33e6dbc257 service nova] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 695.159915] env[65102]: INFO networking_nsxv3.common.synchronization [req-836e1bff-0c30-48eb-8266-2cdedebb9ea8 req-8064cccb-f6f2-4292-b904-1c33e6dbc257 service nova] Enqueued Resource ID: 232c23c9-ffb2-48f4-8094-39a295742f87 with Priority: HIGHEST for action port [ 695.160469] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_rules [ 695.160872] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 695.160872] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 232c23c9-ffb2-48f4-8094-39a295742f87 with Priority: HIGHEST for action port [ 695.161068] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.161534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.161534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.161693] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.161693] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.163093] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.163236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.163497] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-232c23c9-ffb2-48f4-8094-39a295742f87 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.163661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-232c23c9-ffb2-48f4-8094-39a295742f87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.163661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-232c23c9-ffb2-48f4-8094-39a295742f87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.163893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-232c23c9-ffb2-48f4-8094-39a295742f87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.163978] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('232c23c9-ffb2-48f4-8094-39a295742f87',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.389810] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e600993-6aa5-4e81-a0c7-37fe364b4e98 [ 695.390129] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.390295] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.390408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.390688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.390818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.390942] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e600993-6aa5-4e81-a0c7-37fe364b4e98 already deleted. [ 695.391064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e600993-6aa5-4e81-a0c7-37fe364b4e98" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.666542] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.666542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.669150] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 232c23c9-ffb2-48f4-8094-39a295742f87 with status ACTIVE [ 695.673365] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.673365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.673365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.673365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.673365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.673365] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.673365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.673365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.673365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.673365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.673365] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.673365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.673365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.673365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.673365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.673365] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 232c23c9-ffb2-48f4-8094-39a295742f87 is going to be updated. [ 695.695081] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.695807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.695962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.696274] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.696518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.696762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-232c23c9-ffb2-48f4-8094-39a295742f87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.720039] env[65102]: INFO networking_nsxv3.common.synchronization [None req-b695b9b2-461b-43c6-8f5b-9167c6fcad30 None None] Enqueued Resource ID: dd50d100-3294-4834-9ecf-1861e83c1f8c with Priority: HIGHEST for action port [ 695.720039] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd50d100-3294-4834-9ecf-1861e83c1f8c with Priority: HIGHEST for action port [ 695.720039] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd50d100-3294-4834-9ecf-1861e83c1f8c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.720039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd50d100-3294-4834-9ecf-1861e83c1f8c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.720039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd50d100-3294-4834-9ecf-1861e83c1f8c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.720039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd50d100-3294-4834-9ecf-1861e83c1f8c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.720039] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd50d100-3294-4834-9ecf-1861e83c1f8c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.020140] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 696.020140] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 deletion is rescheduled due to dependency. [ 696.020140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.020140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.020407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.020713] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.020812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.020812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.020970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.021092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.021188] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.133629] env[65102]: INFO networking_nsxv3.common.synchronization [req-4d069a26-6dd0-4166-82b9-81d4f538c1a3 req-abc487ed-d786-4c83-bb9c-29db2b4fc4f8 tempest-ServerMetadataNegativeTestJSON-921490363 tempest-ServerMetadataNegativeTestJSON-921490363-project-member] Enqueued Resource ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c with Priority: HIGHEST for action security_group_members [ 696.134466] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c with Priority: HIGHEST for action security_group_members [ 696.135280] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.135280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.135280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.135456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.135757] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.135757] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.135757] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.135900] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.136017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.136134] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a0d050a-9ee7-4daf-868e-6fdb6987f84c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.224970] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd50d100-3294-4834-9ecf-1861e83c1f8c [ 696.225279] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.225419] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.225490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.225736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.225831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.225953] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd50d100-3294-4834-9ecf-1861e83c1f8c already deleted. [ 696.226060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd50d100-3294-4834-9ecf-1861e83c1f8c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.529106] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.639829] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.640672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.640785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.641135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.641664] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.642440] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.642719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.642719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.642944] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.643093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.643217] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c is going to be updated. [ 696.676097] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.676402] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.676402] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.676667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.676856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.688294] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c in Status: IN_PROGRESS for 2s [ 696.825989] env[65102]: INFO networking_nsxv3.common.synchronization [None req-25411c51-667b-4ace-861b-a67abbde6ce7 None None] Enqueued Resource ID: 2b154a0f-cf00-429e-8390-8344178e9d54 with Priority: HIGHEST for action port [ 696.826625] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b154a0f-cf00-429e-8390-8344178e9d54 with Priority: HIGHEST for action port [ 696.826955] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b154a0f-cf00-429e-8390-8344178e9d54 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.828272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b154a0f-cf00-429e-8390-8344178e9d54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.828272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b154a0f-cf00-429e-8390-8344178e9d54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.828272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b154a0f-cf00-429e-8390-8344178e9d54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.828272] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b154a0f-cf00-429e-8390-8344178e9d54',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.031269] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.316902] env[65102]: INFO networking_nsxv3.common.synchronization [req-836e1bff-0c30-48eb-8266-2cdedebb9ea8 req-e13268c8-f895-44b5-af42-924c5f300289 tempest-MultipleCreateTestJSON-827681759 tempest-MultipleCreateTestJSON-827681759-project-member] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 697.317449] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 697.317760] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.317871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.330554] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b154a0f-cf00-429e-8390-8344178e9d54 [ 697.332486] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.332486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.332486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.332486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.332486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.332486] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b154a0f-cf00-429e-8390-8344178e9d54 already deleted. [ 697.332486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b154a0f-cf00-429e-8390-8344178e9d54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.537034] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.537034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.537034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.537034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.537034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.537034] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be updated. [ 697.572933] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.572933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.572933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.572933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.572933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.581710] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: IN_PROGRESS for 2s [ 697.686543] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-833 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.686889] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.686946] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.687618] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.687892] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.688068] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.688187] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.688406] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.688549] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.688750] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.688860] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.688966] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.689081] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.689187] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.689287] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.689412] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.708460] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.708662] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 697.708802] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.708975] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-833" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.709301] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-abb39b9b-672f-498e-b98a-38ab04a19143 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.709469] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-abb39b9b-672f-498e-b98a-38ab04a19143" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.709582] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-abb39b9b-672f-498e-b98a-38ab04a19143" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.709934] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-abb39b9b-672f-498e-b98a-38ab04a19143" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.710094] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abb39b9b-672f-498e-b98a-38ab04a19143',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.212772] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.213172] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.213274] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.213859] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.213859] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.214045] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port abb39b9b-672f-498e-b98a-38ab04a19143 not found, creating... [ 698.214310] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.214480] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.214597] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.215136] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.215273] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.215572] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.215801] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.215858] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.216067] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.216224] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.216385] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: abb39b9b-672f-498e-b98a-38ab04a19143 is going to be created. [ 698.239721] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.239928] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.240060] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.240340] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.240563] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.240783] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-abb39b9b-672f-498e-b98a-38ab04a19143" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.321887] env[65102]: INFO networking_nsxv3.common.synchronization [None req-93246af9-1c0f-4f0b-9f65-493391af4570 tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: 85b46990-bd7b-4abe-881c-9016519cf955 with Priority: HIGHEST for action security_group_rules [ 698.322686] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85b46990-bd7b-4abe-881c-9016519cf955 with Priority: HIGHEST for action security_group_rules [ 698.323241] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85b46990-bd7b-4abe-881c-9016519cf955 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.323483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.323593] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.324428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.324588] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85b46990-bd7b-4abe-881c-9016519cf955',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.450528] env[65102]: INFO networking_nsxv3.common.synchronization [None req-e0f08567-3906-4623-bc99-ba8276538788 tempest-ServersV294TestFqdnHostnames-1427429126 tempest-ServersV294TestFqdnHostnames-1427429126-project-member] Enqueued Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGHEST for action security_group_rules [ 698.451531] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGHEST for action security_group_rules [ 698.451821] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29f22186-8565-4d84-ad72-633756f6f315 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.453034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.453034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.453034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.453034] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29f22186-8565-4d84-ad72-633756f6f315',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.535807] env[65102]: INFO networking_nsxv3.common.synchronization [None req-f99dde7d-97f4-4adb-bc9d-3fbb3f217f9a tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: 85b46990-bd7b-4abe-881c-9016519cf955 with Priority: HIGHEST for action security_group_rules [ 698.536651] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85b46990-bd7b-4abe-881c-9016519cf955 with Priority: HIGHEST for action security_group_rules [ 698.537629] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85b46990-bd7b-4abe-881c-9016519cf955 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.537740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.653570] env[65102]: INFO networking_nsxv3.common.synchronization [req-c3a0db5d-c529-4a4b-9d8d-4047108411b3 req-1a8691f6-b218-47ae-91f6-f756b72e5028 tempest-SecurityGroupRulesNegativeTestJSON-818363803 tempest-SecurityGroupRulesNegativeTestJSON-818363803-project-member] Enqueued Resource ID: 070f472c-05bb-4e4f-aff2-ab8cab8ee487 with Priority: HIGHEST for action security_group_rules [ 698.654574] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070f472c-05bb-4e4f-aff2-ab8cab8ee487 with Priority: HIGHEST for action security_group_rules [ 698.654994] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-070f472c-05bb-4e4f-aff2-ab8cab8ee487 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.655311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-070f472c-05bb-4e4f-aff2-ab8cab8ee487" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.659024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-070f472c-05bb-4e4f-aff2-ab8cab8ee487" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.659024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-070f472c-05bb-4e4f-aff2-ab8cab8ee487" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.659024] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('070f472c-05bb-4e4f-aff2-ab8cab8ee487',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.699587] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c in Status: SUCCESS [ 698.699920] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c deletion is rescheduled due to dependency. [ 698.699920] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.737690] env[65102]: INFO networking_nsxv3.common.synchronization [None req-4701097f-aaa9-4ef3-a8e1-d3faeaaea885 tempest-ServersV294TestFqdnHostnames-1427429126 tempest-ServersV294TestFqdnHostnames-1427429126-project-member] Enqueued Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGHEST for action security_group_rules [ 698.739059] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGHEST for action security_group_rules [ 698.739355] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29f22186-8565-4d84-ad72-633756f6f315 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.739494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.850349] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.850688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.850688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.850798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.850913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.851052] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85b46990-bd7b-4abe-881c-9016519cf955 already deleted. [ 698.851137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.851313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.851483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.851570] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85b46990-bd7b-4abe-881c-9016519cf955',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.981441] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.981788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.981926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.982454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.982454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.982454] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29f22186-8565-4d84-ad72-633756f6f315 already deleted. [ 698.982666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.982853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.983065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.983161] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29f22186-8565-4d84-ad72-633756f6f315',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.061026] env[65102]: INFO networking_nsxv3.common.synchronization [req-836e1bff-0c30-48eb-8266-2cdedebb9ea8 req-f18a8829-f686-4344-b1e9-5b299cd1c749 service nova] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_rules [ 699.061026] env[65102]: INFO networking_nsxv3.common.synchronization [req-836e1bff-0c30-48eb-8266-2cdedebb9ea8 req-f18a8829-f686-4344-b1e9-5b299cd1c749 service nova] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 699.061026] env[65102]: INFO networking_nsxv3.common.synchronization [req-836e1bff-0c30-48eb-8266-2cdedebb9ea8 req-f18a8829-f686-4344-b1e9-5b299cd1c749 service nova] Enqueued Resource ID: abb39b9b-672f-498e-b98a-38ab04a19143 with Priority: HIGHEST for action port [ 699.061026] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_rules [ 699.061026] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 699.061026] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abb39b9b-672f-498e-b98a-38ab04a19143 with Priority: HIGHEST for action port [ 699.061026] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.061584] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.062055] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.062237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.062517] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-abb39b9b-672f-498e-b98a-38ab04a19143 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.062762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abb39b9b-672f-498e-b98a-38ab04a19143" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.062908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abb39b9b-672f-498e-b98a-38ab04a19143" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.063241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abb39b9b-672f-498e-b98a-38ab04a19143" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.063408] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abb39b9b-672f-498e-b98a-38ab04a19143',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.180063] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.180063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.180063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.180402] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.180402] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.180402] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 070f472c-05bb-4e4f-aff2-ab8cab8ee487 already deleted. [ 699.180536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-070f472c-05bb-4e4f-aff2-ab8cab8ee487" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.345749] env[65102]: INFO networking_nsxv3.common.synchronization [None req-bc779d1a-6fc6-459d-b55b-07a9e1336bed None None] Enqueued Resource ID: b9b3596c-9698-4f4d-8e1c-9e7b4eb688cf with Priority: HIGHEST for action port [ 699.345749] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b3596c-9698-4f4d-8e1c-9e7b4eb688cf with Priority: HIGHEST for action port [ 699.345749] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9b3596c-9698-4f4d-8e1c-9e7b4eb688cf taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.345749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9b3596c-9698-4f4d-8e1c-9e7b4eb688cf" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.345749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9b3596c-9698-4f4d-8e1c-9e7b4eb688cf" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.347268] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9b3596c-9698-4f4d-8e1c-9e7b4eb688cf" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.347268] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9b3596c-9698-4f4d-8e1c-9e7b4eb688cf',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.386504] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.387387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.387387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.387387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.387387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.387387] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85b46990-bd7b-4abe-881c-9016519cf955 already deleted. [ 699.387387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.510573] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.510573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.510573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.510573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.510573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.510573] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29f22186-8565-4d84-ad72-633756f6f315 already deleted. [ 699.510573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.565624] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abb39b9b-672f-498e-b98a-38ab04a19143 with status ACTIVE [ 699.569028] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.569028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.569028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.569028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.569028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.569028] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.569028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.569028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.569028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.569028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.569028] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.569028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.569028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.569028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.569028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.569028] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abb39b9b-672f-498e-b98a-38ab04a19143 is going to be updated. [ 699.595141] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 699.595459] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.595633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.595854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.596157] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.596355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.596457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.596714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.596813] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.596969] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.597388] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.599241] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.599412] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.600508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.600508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.600508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.600508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abb39b9b-672f-498e-b98a-38ab04a19143" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.600508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.600508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.600679] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.600738] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.600766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.600911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.600962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.601459] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.851771] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9b3596c-9698-4f4d-8e1c-9e7b4eb688cf [ 699.851771] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.851771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.851771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.851771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.851771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.851771] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9b3596c-9698-4f4d-8e1c-9e7b4eb688cf already deleted. [ 699.851771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9b3596c-9698-4f4d-8e1c-9e7b4eb688cf" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.104528] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.104760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.105036] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.608030] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.110262] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.110796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.110796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.110796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.110796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.110970] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be updated. [ 701.141844] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.142083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.142129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.142377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.142551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.159063] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: IN_PROGRESS for 2s [ 701.162129] env[65102]: INFO networking_nsxv3.common.synchronization [req-b6ef297b-efd5-47b1-b8af-7b72f29c1dca req-9f68a99d-e87a-4e0e-9630-8d8eb3ecb8b1 tempest-SecurityGroupRulesNegativeTestJSON-818363803 tempest-SecurityGroupRulesNegativeTestJSON-818363803-project-member] Enqueued Resource ID: 070f472c-05bb-4e4f-aff2-ab8cab8ee487 with Priority: HIGHEST for action security_group_rules [ 701.163598] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070f472c-05bb-4e4f-aff2-ab8cab8ee487 with Priority: HIGHEST for action security_group_rules [ 701.163978] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-070f472c-05bb-4e4f-aff2-ab8cab8ee487 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.164376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-070f472c-05bb-4e4f-aff2-ab8cab8ee487" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.164859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-070f472c-05bb-4e4f-aff2-ab8cab8ee487" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.165104] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-070f472c-05bb-4e4f-aff2-ab8cab8ee487" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.165189] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('070f472c-05bb-4e4f-aff2-ab8cab8ee487',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.688095] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.688208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.688208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.688407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.688530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.688591] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 070f472c-05bb-4e4f-aff2-ab8cab8ee487 already deleted. [ 701.688735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-070f472c-05bb-4e4f-aff2-ab8cab8ee487" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.172286] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 703.174780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.174780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.174780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.174780] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.174780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.174780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.174780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.174780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.174780] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.676490] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.180854] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.683927] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.687107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.687107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.687107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.687107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.687107] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be updated. [ 704.728986] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.729248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.729319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.729490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.729649] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.745036] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: IN_PROGRESS for 2s [ 706.164900] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 706.165348] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 706.758129] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 706.758366] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.758539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.758756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.758953] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.759093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.759162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.759322] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.759701] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.759701] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.759701] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.759894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.759894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.759965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.760074] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.760167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.760228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.760358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.760436] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.760505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.760589] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.263430] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1: rpc.has_security_group_logging(os_id): False [ 707.287386] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.287577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.287622] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.287801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.289265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.289265] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.289265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.289265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.289265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.289265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.289265] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.289265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.289265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.289265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.289265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.289265] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.289265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.290017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.290017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.290017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.290017] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be updated. [ 707.382419] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.382614] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.382650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.382896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.383081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.402516] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: IN_PROGRESS for 2s [ 709.281640] env[65102]: INFO networking_nsxv3.common.synchronization [req-81c7eb61-303f-40d4-9860-61e4e2727bfe req-c97f1b79-af94-45c6-a9ac-f709654b5b92 tempest-FloatingIPsAssociationTestJSON-1065123087 tempest-FloatingIPsAssociationTestJSON-1065123087-project-member] Enqueued Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_members [ 709.282332] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_members [ 709.282766] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.282959] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.284578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.284578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.284729] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.284838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.284901] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.285286] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.285409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.285512] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.426343] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 709.426670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.426746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.426903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.426984] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.664518] env[65102]: INFO networking_nsxv3.common.synchronization [None req-79bb18a6-885d-4de5-8384-ac3b8d11ff65 None None] Enqueued Resource ID: 8a793a05-1729-434c-8350-0a2d8ff758b5 with Priority: HIGHEST for action port [ 709.666165] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a793a05-1729-434c-8350-0a2d8ff758b5 with Priority: HIGHEST for action port [ 709.666608] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a793a05-1729-434c-8350-0a2d8ff758b5 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.667464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a793a05-1729-434c-8350-0a2d8ff758b5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.667605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a793a05-1729-434c-8350-0a2d8ff758b5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.667902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a793a05-1729-434c-8350-0a2d8ff758b5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.668646] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a793a05-1729-434c-8350-0a2d8ff758b5',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.703079] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.703283] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-985" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.703388] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-985" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.703786] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-985" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.703988] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.704239] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.704356] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.704931] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.705141] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.705365] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.705511] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.705674] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.705777] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.705896] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.706018] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.706155] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.730667] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.731291] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 709.731291] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.731291] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-985" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.731672] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-2ec2fffa-a684-4c3d-8ead-2c8b74d6252d taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.732182] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-2ec2fffa-a684-4c3d-8ead-2c8b74d6252d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.732182] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-2ec2fffa-a684-4c3d-8ead-2c8b74d6252d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.732699] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-2ec2fffa-a684-4c3d-8ead-2c8b74d6252d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.732864] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ec2fffa-a684-4c3d-8ead-2c8b74d6252d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.789276] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.789504] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.789572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.789855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.789936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.790185] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.790357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.790420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.790645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.790778] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.790904] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b07f4606-a04e-468f-8194-7420bcbd987d already deleted. [ 709.790997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.929845] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.930097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.930144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.930433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.930895] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.930895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.930895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.931164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.931237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.931406] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.931555] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.171369] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a793a05-1729-434c-8350-0a2d8ff758b5 [ 710.171773] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.171961] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.172025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.172324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.173651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.173788] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a793a05-1729-434c-8350-0a2d8ff758b5 already deleted. [ 710.173995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a793a05-1729-434c-8350-0a2d8ff758b5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.236258] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.236420] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.236738] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.237181] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.237441] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.237708] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 2ec2fffa-a684-4c3d-8ead-2c8b74d6252d not found, creating... [ 710.241856] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.242094] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.242219] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.242494] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.242642] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.243167] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.243349] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.243488] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.243736] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.243999] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.244081] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 2ec2fffa-a684-4c3d-8ead-2c8b74d6252d is going to be created. [ 710.280932] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.280932] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.281188] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.281357] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.281704] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.282863] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-2ec2fffa-a684-4c3d-8ead-2c8b74d6252d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.434492] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.434742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.434857] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.435153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.435342] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.435446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.435510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.435732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.435870] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.436010] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.436943] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.436943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.436943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.436943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.436943] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.436943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.437240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.437240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.437310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.437410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.437549] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.940693] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1: rpc.has_security_group_logging(os_id): False [ 710.961047] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.961291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.961405] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.961659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.961754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.961999] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.962128] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.962190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.962351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.962432] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.962624] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.962733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.962817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.962991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.964921] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.965133] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.965306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.965306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.965449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.965501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.965596] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be updated. [ 711.036896] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.036896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.036896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.036896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.037118] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.040166] env[65102]: INFO networking_nsxv3.common.synchronization [req-81c7eb61-303f-40d4-9860-61e4e2727bfe req-b614df54-5bb3-45b6-b886-ba62e8888795 service nova] Enqueued Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_rules [ 711.040368] env[65102]: INFO networking_nsxv3.common.synchronization [req-81c7eb61-303f-40d4-9860-61e4e2727bfe req-b614df54-5bb3-45b6-b886-ba62e8888795 service nova] Enqueued Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_members [ 711.040455] env[65102]: INFO networking_nsxv3.common.synchronization [req-81c7eb61-303f-40d4-9860-61e4e2727bfe req-b614df54-5bb3-45b6-b886-ba62e8888795 service nova] Enqueued Resource ID: 2ec2fffa-a684-4c3d-8ead-2c8b74d6252d with Priority: HIGHEST for action port [ 711.041255] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_rules [ 711.041255] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_members [ 711.041255] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ec2fffa-a684-4c3d-8ead-2c8b74d6252d with Priority: HIGHEST for action port [ 711.041464] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.041582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.041648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.041897] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.041986] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.043513] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.043513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.043645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.043811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.043872] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.043969] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.044046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.044253] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.044343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.044437] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.045552] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ec2fffa-a684-4c3d-8ead-2c8b74d6252d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.045552] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ec2fffa-a684-4c3d-8ead-2c8b74d6252d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.045552] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ec2fffa-a684-4c3d-8ead-2c8b74d6252d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.045685] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ec2fffa-a684-4c3d-8ead-2c8b74d6252d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.045718] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ec2fffa-a684-4c3d-8ead-2c8b74d6252d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.056395] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: IN_PROGRESS for 2s [ 711.312064] env[65102]: INFO networking_nsxv3.common.synchronization [req-48200f5a-037a-45d4-9b6e-78ddf7924c6d req-64489352-60af-4d7d-8fa4-458c744b5bea tempest-MultipleCreateTestJSON-827681759 tempest-MultipleCreateTestJSON-827681759-project-member] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 711.312673] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 711.312877] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.313255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.313255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.313391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.313564] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.313671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.313737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.313884] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.313974] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.314294] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.350403] env[65102]: INFO networking_nsxv3.common.synchronization [None req-b6c003a9-4791-4151-9e86-f30fa6218dd2 None None] Enqueued Resource ID: 2554176e-fce7-42e7-a3d9-e006c1d05796 with Priority: HIGHEST for action port [ 711.350870] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2554176e-fce7-42e7-a3d9-e006c1d05796 with Priority: HIGHEST for action port [ 711.351399] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-2554176e-fce7-42e7-a3d9-e006c1d05796 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.351535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2554176e-fce7-42e7-a3d9-e006c1d05796" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.351602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2554176e-fce7-42e7-a3d9-e006c1d05796" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.351910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2554176e-fce7-42e7-a3d9-e006c1d05796" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.352009] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2554176e-fce7-42e7-a3d9-e006c1d05796',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.550121] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.550121] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.550121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.550121] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ec2fffa-a684-4c3d-8ead-2c8b74d6252d with status ACTIVE [ 711.550121] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.550121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.550121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.550121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.550121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.550121] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.550121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.550121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.550121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.550121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.551191] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.551410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.551556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.551890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.552080] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.552270] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ec2fffa-a684-4c3d-8ead-2c8b74d6252d is going to be updated. [ 711.579894] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.580329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.580868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.581438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.581672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.581932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ec2fffa-a684-4c3d-8ead-2c8b74d6252d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.689356] env[65102]: INFO networking_nsxv3.common.synchronization [None req-a6b6e73b-a98b-4a8e-aa5d-4ed2ad2d2b6e tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 with Priority: HIGHEST for action security_group_rules [ 711.689922] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 with Priority: HIGHEST for action security_group_rules [ 711.690273] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.690400] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.690459] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.690710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.690789] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce19aa8e-b26d-4484-8765-4894bdbb95a0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.816733] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.854727] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2554176e-fce7-42e7-a3d9-e006c1d05796 [ 711.854727] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.854868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.854916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.855358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.855358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.855358] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2554176e-fce7-42e7-a3d9-e006c1d05796 already deleted. [ 711.855517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2554176e-fce7-42e7-a3d9-e006c1d05796" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.006949] env[65102]: INFO networking_nsxv3.common.synchronization [req-4b19ffea-90d2-443f-9b9c-34a51a1a37da req-c774fb55-3dd0-454f-bab6-c57c53462e57 tempest-MultipleCreateTestJSON-827681759 tempest-MultipleCreateTestJSON-827681759-project-member] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 712.006949] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGHEST for action security_group_members [ 712.006949] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.006949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.049749] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.120502] env[65102]: INFO networking_nsxv3.common.synchronization [req-b59619d8-c165-4a2e-8bd8-5747563592e8 req-49be1f58-5d57-4221-8ab7-450d501a3975 tempest-DeleteServersTestJSON-1773899535 tempest-DeleteServersTestJSON-1773899535-project-member] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 712.123574] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 712.125122] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.125122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.125122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.125122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.125122] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.125122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.125122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.125122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.125557] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.125557] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.206828] env[65102]: INFO networking_nsxv3.common.synchronization [None req-b2cc99e3-8594-4fcf-b3c9-d0ee43d58cbd tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 with Priority: HIGHEST for action security_group_rules [ 712.208143] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 with Priority: HIGHEST for action security_group_rules [ 712.208822] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.209120] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.221264] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.222425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.222425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.222425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.222425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.222425] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 already deleted. [ 712.222425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.222425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.222701] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.222701] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce19aa8e-b26d-4484-8765-4894bdbb95a0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.318758] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.553558] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.555228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.555228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.555228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.555228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.555228] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b07f4606-a04e-468f-8194-7420bcbd987d is going to be created. [ 712.584813] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.584976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.585057] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.585314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.585493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.596949] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: UNINITIALIZED for 2s [ 712.628876] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.628876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.628876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.629061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.629061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.629273] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.629387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.630026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.630026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.630026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.630026] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 712.671250] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.671482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.671558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.675027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.675027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.684430] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 712.687697] env[65102]: INFO networking_nsxv3.common.synchronization [None req-4f230f86-fd7f-4d6b-b8c9-a7c389e2ab5e None None] Enqueued Resource ID: 583bf37e-c1a3-4dd6-afc0-a71350730ace with Priority: HIGHEST for action port [ 712.688326] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583bf37e-c1a3-4dd6-afc0-a71350730ace with Priority: HIGHEST for action port [ 712.688648] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-583bf37e-c1a3-4dd6-afc0-a71350730ace taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.688804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-583bf37e-c1a3-4dd6-afc0-a71350730ace" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.688870] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-583bf37e-c1a3-4dd6-afc0-a71350730ace" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.689234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-583bf37e-c1a3-4dd6-afc0-a71350730ace" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.689341] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('583bf37e-c1a3-4dd6-afc0-a71350730ace',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.702877] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.703082] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.703219] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.703518] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.703780] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.703932] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.705458] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.705777] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.705939] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.706181] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.706293] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.706412] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.706492] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.706628] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.706762] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.706898] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.731435] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.731612] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 712.731752] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.731925] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.733345] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-abf46aae-348e-4b4b-acfe-35830ba162e1 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.733345] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-abf46aae-348e-4b4b-acfe-35830ba162e1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.733345] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-abf46aae-348e-4b4b-acfe-35830ba162e1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.733345] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-abf46aae-348e-4b4b-acfe-35830ba162e1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.733584] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abf46aae-348e-4b4b-acfe-35830ba162e1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.747148] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.747332] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.747407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.747676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.747856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.747947] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 already deleted. [ 712.748051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.824415] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.824415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.824415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.824415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.824415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.824415] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be updated. [ 712.858278] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.858485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.858584] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.858727] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.858886] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.880312] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: IN_PROGRESS for 2s [ 713.079681] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 713.081843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.192017] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 583bf37e-c1a3-4dd6-afc0-a71350730ace [ 713.192444] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.192860] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.192860] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.193115] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.193219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.193590] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:583bf37e-c1a3-4dd6-afc0-a71350730ace already deleted. [ 713.193590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-583bf37e-c1a3-4dd6-afc0-a71350730ace" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.236369] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.236647] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.236784] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.237065] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.237229] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.237375] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port abf46aae-348e-4b4b-acfe-35830ba162e1 not found, creating... [ 713.237630] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.237783] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.237895] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.238136] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.238277] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.238552] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.238723] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.238844] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.239576] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.239806] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.240091] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: abf46aae-348e-4b4b-acfe-35830ba162e1 is going to be created. [ 713.274076] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.274424] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.274693] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.275119] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.275460] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.275832] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-abf46aae-348e-4b4b-acfe-35830ba162e1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.900175] env[65102]: INFO networking_nsxv3.common.synchronization [None req-05efeaa8-c858-470e-9bec-40291c5ac2a5 None None] Enqueued Resource ID: cd000654-efea-44a6-a2bd-4ae828dfa345 with Priority: HIGHEST for action port [ 713.900175] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd000654-efea-44a6-a2bd-4ae828dfa345 with Priority: HIGHEST for action port [ 713.900982] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd000654-efea-44a6-a2bd-4ae828dfa345 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.901456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd000654-efea-44a6-a2bd-4ae828dfa345" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.901734] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd000654-efea-44a6-a2bd-4ae828dfa345" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.902164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd000654-efea-44a6-a2bd-4ae828dfa345" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.902587] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd000654-efea-44a6-a2bd-4ae828dfa345',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.028394] env[65102]: INFO networking_nsxv3.common.synchronization [req-b59619d8-c165-4a2e-8bd8-5747563592e8 req-8bd327de-359c-4f5d-93b6-77a31843650d service nova] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_rules [ 714.028394] env[65102]: INFO networking_nsxv3.common.synchronization [req-b59619d8-c165-4a2e-8bd8-5747563592e8 req-8bd327de-359c-4f5d-93b6-77a31843650d service nova] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 714.028394] env[65102]: INFO networking_nsxv3.common.synchronization [req-b59619d8-c165-4a2e-8bd8-5747563592e8 req-8bd327de-359c-4f5d-93b6-77a31843650d service nova] Enqueued Resource ID: abf46aae-348e-4b4b-acfe-35830ba162e1 with Priority: HIGHEST for action port [ 714.028394] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_rules [ 714.028394] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 714.028394] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf46aae-348e-4b4b-acfe-35830ba162e1 with Priority: HIGHEST for action port [ 714.028394] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.028394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.029980] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.030609] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.030833] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.032178] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.034017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.034017] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-abf46aae-348e-4b4b-acfe-35830ba162e1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.034017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abf46aae-348e-4b4b-acfe-35830ba162e1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.034017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abf46aae-348e-4b4b-acfe-35830ba162e1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.034017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abf46aae-348e-4b4b-acfe-35830ba162e1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.034017] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abf46aae-348e-4b4b-acfe-35830ba162e1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.405626] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd000654-efea-44a6-a2bd-4ae828dfa345 [ 714.405854] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.405992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.406081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.406377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.406495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.406495] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd000654-efea-44a6-a2bd-4ae828dfa345 already deleted. [ 714.406556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd000654-efea-44a6-a2bd-4ae828dfa345" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.536543] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abf46aae-348e-4b4b-acfe-35830ba162e1 with status ACTIVE [ 714.537950] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.538097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.538167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.538547] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.539160] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.539160] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.540096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.540096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.540096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.540096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.540096] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.540311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.540311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.540542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.540542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.540625] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abf46aae-348e-4b4b-acfe-35830ba162e1 is going to be updated. [ 714.541775] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.541909] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.569266] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.569266] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.569266] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.569732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.569958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.570611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abf46aae-348e-4b4b-acfe-35830ba162e1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.608205] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: SUCCESS [ 714.608422] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.608595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.608811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.608997] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.609132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.609195] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.609359] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.609434] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.609516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.609603] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.699175] env[65102]: INFO networking_nsxv3.common.synchronization [req-8d85aa8b-1409-4e36-8d0d-6df5f32907a1 req-c8aa076d-a0de-4487-a0e9-c030bb99d5d1 tempest-ListServersNegativeTestJSON-1289631193 tempest-ListServersNegativeTestJSON-1289631193-project-member] Enqueued Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 714.699799] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 714.700397] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.700541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.700616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.702437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.702437] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.702437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.702437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.702437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.702437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.702437] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.706209] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 714.706298] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f deletion is rescheduled due to dependency. [ 714.706366] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.708054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.708054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.708054] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.708054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.708054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.708054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.708054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.708384] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.893269] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 714.893996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.894233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.894515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.894719] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.894834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.894903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.895077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.895161] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.895270] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.114112] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.114112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.114112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.114112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.114112] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.114112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.114112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.114112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.114112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.114112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.114112] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.114112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.114112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.114112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.114854] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.114854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.114854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.114854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.114854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.114854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.115022] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.146223] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-348 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.146223] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-348" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.146223] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-348" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.146516] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-348" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.146734] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.146900] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.147042] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.147473] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.147652] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.147876] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.147991] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.148624] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.148624] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.148624] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.148624] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.148624] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.170454] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.170706] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 715.170876] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.171125] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-348" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.171542] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-53ef6db1-9d79-43ac-ad0a-c794a9fed04d taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.171757] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-53ef6db1-9d79-43ac-ad0a-c794a9fed04d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.171948] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-53ef6db1-9d79-43ac-ad0a-c794a9fed04d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.172331] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-53ef6db1-9d79-43ac-ad0a-c794a9fed04d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.172490] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53ef6db1-9d79-43ac-ad0a-c794a9fed04d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.203674] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.203865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.203944] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.204196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.204383] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.204608] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.204822] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.204822] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.204990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.205092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.205184] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd already deleted. [ 715.205332] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.210273] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.397749] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.397979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.398076] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.398314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.398411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.398645] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.398761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.398823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.399021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.399083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.399177] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be updated. [ 715.434466] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.434687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.434810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.435124] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.435311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.446215] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: IN_PROGRESS for 2s [ 715.618756] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b07f4606-a04e-468f-8194-7420bcbd987d: rpc.has_security_group_logging(os_id): False [ 715.642176] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.642365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.642435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.642648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.642745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.643120] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.643120] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.643380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.643380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.643380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.643558] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.643655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.643738] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.643876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.643949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.644196] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.644376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.644473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.644583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.644660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.644750] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b07f4606-a04e-468f-8194-7420bcbd987d is going to be created. [ 715.675777] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.676618] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.676618] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.676912] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.677212] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.677481] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 53ef6db1-9d79-43ac-ad0a-c794a9fed04d not found, creating... [ 715.677928] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.678205] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.678392] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.678720] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.678881] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.679359] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.679620] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.679783] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.680132] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.680333] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.680553] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 53ef6db1-9d79-43ac-ad0a-c794a9fed04d is going to be created. [ 715.710974] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.711247] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.711325] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.711604] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.711869] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.712105] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-53ef6db1-9d79-43ac-ad0a-c794a9fed04d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.713184] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.731289] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.731484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.731622] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.731841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.732076] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.749185] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: IN_PROGRESS for 2s [ 716.215274] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.215678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.215678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.215872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.216019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.216131] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 716.248360] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.249270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.249270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.249270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.249270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.259949] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 716.437273] env[65102]: INFO networking_nsxv3.common.synchronization [req-8d85aa8b-1409-4e36-8d0d-6df5f32907a1 req-51304b91-583a-4c09-bf52-aa969c56e65e service nova] Enqueued Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_rules [ 716.437447] env[65102]: INFO networking_nsxv3.common.synchronization [req-8d85aa8b-1409-4e36-8d0d-6df5f32907a1 req-51304b91-583a-4c09-bf52-aa969c56e65e service nova] Enqueued Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 716.437582] env[65102]: INFO networking_nsxv3.common.synchronization [req-8d85aa8b-1409-4e36-8d0d-6df5f32907a1 req-51304b91-583a-4c09-bf52-aa969c56e65e service nova] Enqueued Resource ID: 53ef6db1-9d79-43ac-ad0a-c794a9fed04d with Priority: HIGHEST for action port [ 716.438122] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_rules [ 716.438265] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 716.438399] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53ef6db1-9d79-43ac-ad0a-c794a9fed04d with Priority: HIGHEST for action port [ 716.438777] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.438871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.438942] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.439211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.439296] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.440236] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.440356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.440424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.440640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.440768] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.440865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.440925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.441078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.441192] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.441252] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.442013] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-53ef6db1-9d79-43ac-ad0a-c794a9fed04d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.442130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53ef6db1-9d79-43ac-ad0a-c794a9fed04d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.442225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53ef6db1-9d79-43ac-ad0a-c794a9fed04d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.442342] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53ef6db1-9d79-43ac-ad0a-c794a9fed04d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.442629] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53ef6db1-9d79-43ac-ad0a-c794a9fed04d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.789630] env[65102]: INFO networking_nsxv3.common.synchronization [req-8d85aa8b-1409-4e36-8d0d-6df5f32907a1 req-bc13a877-5394-4a10-8425-3ee114f3e4c6 tempest-ListServersNegativeTestJSON-1289631193 tempest-ListServersNegativeTestJSON-1289631193-project-member] Enqueued Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 716.791349] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 716.791611] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.791732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.943955] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.944104] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.944414] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.945342] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53ef6db1-9d79-43ac-ad0a-c794a9fed04d with status ACTIVE [ 716.945563] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.945903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.945903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.946455] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.946455] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.946455] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.946603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.946642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.946974] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.946974] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.947259] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.947390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.947493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.947777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.947898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.948169] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53ef6db1-9d79-43ac-ad0a-c794a9fed04d is going to be updated. [ 716.971911] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.972123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.972212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.972481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.972687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.972880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53ef6db1-9d79-43ac-ad0a-c794a9fed04d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.169961] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-348 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.169961] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-348" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.169961] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-348" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.169961] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-348" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.170371] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.170371] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.170487] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.171236] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.171236] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.171236] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.171236] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.171236] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.171401] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.171441] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.171542] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.171646] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.192444] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.192444] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 717.192444] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.192649] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-348" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.192866] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-7b78f034-800f-47c1-9c6f-7e94df8703b1 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.193285] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-7b78f034-800f-47c1-9c6f-7e94df8703b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.193285] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-7b78f034-800f-47c1-9c6f-7e94df8703b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.195318] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-7b78f034-800f-47c1-9c6f-7e94df8703b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.195318] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b78f034-800f-47c1-9c6f-7e94df8703b1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.283973] env[65102]: INFO networking_nsxv3.common.synchronization [None req-fd079400-5706-4d04-8862-2e8df45efa05 None None] Enqueued Resource ID: c26ac9f7-2989-4abd-8d3d-a6dd2cd80a70 with Priority: HIGHEST for action port [ 717.284595] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c26ac9f7-2989-4abd-8d3d-a6dd2cd80a70 with Priority: HIGHEST for action port [ 717.285029] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-c26ac9f7-2989-4abd-8d3d-a6dd2cd80a70 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.285154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c26ac9f7-2989-4abd-8d3d-a6dd2cd80a70" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.285219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c26ac9f7-2989-4abd-8d3d-a6dd2cd80a70" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.285501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c26ac9f7-2989-4abd-8d3d-a6dd2cd80a70" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.285625] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c26ac9f7-2989-4abd-8d3d-a6dd2cd80a70',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.451048] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.458732] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 in Status: SUCCESS [ 717.459057] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 deletion is rescheduled due to dependency. [ 717.459195] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.699288] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.699288] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.699288] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.699288] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.699288] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.699288] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 7b78f034-800f-47c1-9c6f-7e94df8703b1 not found, creating... [ 717.699288] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.699288] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.699288] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.699288] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.699288] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.699759] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.699759] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.699759] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.699759] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.700179] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.700498] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 7b78f034-800f-47c1-9c6f-7e94df8703b1 is going to be created. [ 717.726024] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.726024] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.726024] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.726271] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.726512] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.726794] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-7b78f034-800f-47c1-9c6f-7e94df8703b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.764161] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: SUCCESS [ 717.764555] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.788334] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c26ac9f7-2989-4abd-8d3d-a6dd2cd80a70 [ 717.788622] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.788788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.788913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.789145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.789251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.789357] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c26ac9f7-2989-4abd-8d3d-a6dd2cd80a70 already deleted. [ 717.789447] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c26ac9f7-2989-4abd-8d3d-a6dd2cd80a70" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.954423] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.954603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.954644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.954976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.955098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.955225] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd is going to be created. [ 717.984010] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.984171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.984245] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.984541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.984703] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.998373] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: UNINITIALIZED for 2s [ 718.270609] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 718.270814] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.270989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.271281] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.271483] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.271606] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.271675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.271828] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.271915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.272014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.272121] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.437575] env[65102]: INFO networking_nsxv3.common.synchronization [req-8d85aa8b-1409-4e36-8d0d-6df5f32907a1 req-b4bb7614-c6b4-413f-85d6-c1132bda38c9 service nova] Enqueued Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_rules [ 718.437575] env[65102]: INFO networking_nsxv3.common.synchronization [req-8d85aa8b-1409-4e36-8d0d-6df5f32907a1 req-b4bb7614-c6b4-413f-85d6-c1132bda38c9 service nova] Enqueued Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 718.437575] env[65102]: INFO networking_nsxv3.common.synchronization [req-8d85aa8b-1409-4e36-8d0d-6df5f32907a1 req-b4bb7614-c6b4-413f-85d6-c1132bda38c9 service nova] Enqueued Resource ID: 7b78f034-800f-47c1-9c6f-7e94df8703b1 with Priority: HIGHEST for action port [ 718.437575] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_rules [ 718.437575] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 718.437575] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b78f034-800f-47c1-9c6f-7e94df8703b1 with Priority: HIGHEST for action port [ 718.437575] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.437575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.439600] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.439600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.439600] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b78f034-800f-47c1-9c6f-7e94df8703b1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.439600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b78f034-800f-47c1-9c6f-7e94df8703b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.439600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b78f034-800f-47c1-9c6f-7e94df8703b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.439600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b78f034-800f-47c1-9c6f-7e94df8703b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.439600] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b78f034-800f-47c1-9c6f-7e94df8703b1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.778765] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.778765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.778765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.778765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.778765] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.778765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.778765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.778765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.778765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.778765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.778765] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.778765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.778765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.778765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.778765] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.778765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.779305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.779305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.779305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.779305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.779305] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.828152] env[65102]: INFO networking_nsxv3.common.synchronization [req-8d85aa8b-1409-4e36-8d0d-6df5f32907a1 req-02a5a41c-6b60-46b4-a040-a1046135493f tempest-ListServersNegativeTestJSON-1289631193 tempest-ListServersNegativeTestJSON-1289631193-project-member] Enqueued Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 718.828634] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 718.829110] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.829371] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.942057] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b78f034-800f-47c1-9c6f-7e94df8703b1 with status ACTIVE [ 718.942762] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.942762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.942762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.943532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.943532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.943532] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.943740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.943882] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.944137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.944314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.944728] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.944885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.945326] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.945433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.945541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.946064] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b78f034-800f-47c1-9c6f-7e94df8703b1 is going to be updated. [ 718.981112] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.981112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.981112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.981112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.981112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.981112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b78f034-800f-47c1-9c6f-7e94df8703b1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.209292] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-348 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.209292] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-348" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.209292] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-348" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.209292] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-348" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.209292] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.209292] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.209750] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.209750] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.209808] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.210042] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.210157] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.210258] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.210380] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.210483] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.210591] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.210731] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.232425] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.232692] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 719.232889] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.232948] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-348" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.233472] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-52873450-f314-4110-a316-7380569e0afe taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.233781] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-52873450-f314-4110-a316-7380569e0afe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.234103] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-52873450-f314-4110-a316-7380569e0afe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.234798] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-52873450-f314-4110-a316-7380569e0afe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.235053] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52873450-f314-4110-a316-7380569e0afe',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.284688] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99c8f96e-2cdb-49cd-8847-bf7698ff539f: rpc.has_security_group_logging(os_id): False [ 719.306663] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.306846] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.306920] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.307163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.307261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.307478] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.307582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.307654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.307813] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.307884] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.308081] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.308204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.308268] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.308411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.308489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.308668] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.308768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.308837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.308972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.309063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.309172] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 719.397425] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.397651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.397724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.397970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.398154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.413227] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 719.702033] env[65102]: INFO networking_nsxv3.common.synchronization [None req-4f3271e0-d1f9-4582-bef5-bd982a3a9dff None None] Enqueued Resource ID: d7c3ebde-7bc3-491c-9eb5-a07340f643fa with Priority: HIGHEST for action port [ 719.703215] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c3ebde-7bc3-491c-9eb5-a07340f643fa with Priority: HIGHEST for action port [ 719.703953] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7c3ebde-7bc3-491c-9eb5-a07340f643fa taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.703953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7c3ebde-7bc3-491c-9eb5-a07340f643fa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.704242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7c3ebde-7bc3-491c-9eb5-a07340f643fa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.707325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7c3ebde-7bc3-491c-9eb5-a07340f643fa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.707325] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7c3ebde-7bc3-491c-9eb5-a07340f643fa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.739343] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.739343] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.739480] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.740117] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.740117] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.741191] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 52873450-f314-4110-a316-7380569e0afe not found, creating... [ 719.741191] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.741191] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.741191] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.741191] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.741448] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.741729] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.742090] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.742090] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.742364] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.742647] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.742707] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 52873450-f314-4110-a316-7380569e0afe is going to be created. [ 719.770299] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.770766] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.771020] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.771277] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.771776] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.772088] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-52873450-f314-4110-a316-7380569e0afe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.011536] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: SUCCESS [ 720.011773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.011998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.012246] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.012653] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.012829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.012896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.013101] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.013186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.013342] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.207482] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7c3ebde-7bc3-491c-9eb5-a07340f643fa [ 720.207611] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.207753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.207831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.208135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.208234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.208342] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7c3ebde-7bc3-491c-9eb5-a07340f643fa already deleted. [ 720.208511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7c3ebde-7bc3-491c-9eb5-a07340f643fa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.295361] env[65102]: INFO networking_nsxv3.common.synchronization [req-0db6947f-129d-47bc-bdf0-7d4107e8d1b5 req-23887b7e-755b-47e9-a63e-ec9900127d83 tempest-ServerRescueTestJSONUnderV235-1815693667 tempest-ServerRescueTestJSONUnderV235-1815693667-project-member] Enqueued Resource ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb with Priority: HIGHEST for action security_group_members [ 720.295361] env[65102]: INFO networking_nsxv3.common.synchronization [req-0db6947f-129d-47bc-bdf0-7d4107e8d1b5 req-23887b7e-755b-47e9-a63e-ec9900127d83 tempest-ServerRescueTestJSONUnderV235-1815693667 tempest-ServerRescueTestJSONUnderV235-1815693667-project-member] Enqueued Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_members [ 720.296971] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb with Priority: HIGHEST for action security_group_members [ 720.296971] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_members [ 720.296971] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.296971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.296971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.296971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.296971] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.298437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.298437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.298437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.298437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.298437] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e19a668-bcb8-48c2-b8b7-65bda673e4bb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.298603] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.298603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.298682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.298883] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.299042] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.299222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.299222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.299411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.299411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.299507] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.363881] env[65102]: INFO networking_nsxv3.common.synchronization [req-0db6947f-129d-47bc-bdf0-7d4107e8d1b5 req-23887b7e-755b-47e9-a63e-ec9900127d83 tempest-ServerRescueTestJSONUnderV235-1815693667 tempest-ServerRescueTestJSONUnderV235-1815693667-project-member] Enqueued Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_rules [ 720.363881] env[65102]: INFO networking_nsxv3.common.synchronization [req-0db6947f-129d-47bc-bdf0-7d4107e8d1b5 req-23887b7e-755b-47e9-a63e-ec9900127d83 tempest-ServerRescueTestJSONUnderV235-1815693667 tempest-ServerRescueTestJSONUnderV235-1815693667-project-member] Enqueued Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_members [ 720.363881] env[65102]: INFO networking_nsxv3.common.synchronization [req-0db6947f-129d-47bc-bdf0-7d4107e8d1b5 req-23887b7e-755b-47e9-a63e-ec9900127d83 tempest-ServerRescueTestJSONUnderV235-1815693667 tempest-ServerRescueTestJSONUnderV235-1815693667-project-member] Enqueued Resource ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb with Priority: HIGHEST for action security_group_rules [ 720.364496] env[65102]: INFO networking_nsxv3.common.synchronization [req-0db6947f-129d-47bc-bdf0-7d4107e8d1b5 req-23887b7e-755b-47e9-a63e-ec9900127d83 tempest-ServerRescueTestJSONUnderV235-1815693667 tempest-ServerRescueTestJSONUnderV235-1815693667-project-member] Enqueued Resource ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb with Priority: HIGHEST for action security_group_members [ 720.364496] env[65102]: INFO networking_nsxv3.common.synchronization [req-0db6947f-129d-47bc-bdf0-7d4107e8d1b5 req-23887b7e-755b-47e9-a63e-ec9900127d83 tempest-ServerRescueTestJSONUnderV235-1815693667 tempest-ServerRescueTestJSONUnderV235-1815693667-project-member] Enqueued Resource ID: 41ad83e5-4645-4e91-a223-473eefb69c38 with Priority: HIGHEST for action port [ 720.365268] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_rules [ 720.365422] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb with Priority: HIGHEST for action security_group_rules [ 720.365732] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ad83e5-4645-4e91-a223-473eefb69c38 with Priority: HIGHEST for action port [ 720.365732] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_members [ 720.365795] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb with Priority: HIGHEST for action security_group_members [ 720.366042] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.366170] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.366236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.366439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.366522] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.367612] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e19a668-bcb8-48c2-b8b7-65bda673e4bb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.367612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.367612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.367821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.367947] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e19a668-bcb8-48c2-b8b7-65bda673e4bb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.369641] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-41ad83e5-4645-4e91-a223-473eefb69c38 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.369641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.369641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.369641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.369641] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41ad83e5-4645-4e91-a223-473eefb69c38',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.369905] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.369969] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.370754] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.370754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.516190] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.539734] env[65102]: INFO networking_nsxv3.common.synchronization [req-8d85aa8b-1409-4e36-8d0d-6df5f32907a1 req-b641017b-9b02-4050-a580-87306bd8e98e service nova] Enqueued Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_rules [ 720.539915] env[65102]: INFO networking_nsxv3.common.synchronization [req-8d85aa8b-1409-4e36-8d0d-6df5f32907a1 req-b641017b-9b02-4050-a580-87306bd8e98e service nova] Enqueued Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 720.540071] env[65102]: INFO networking_nsxv3.common.synchronization [req-8d85aa8b-1409-4e36-8d0d-6df5f32907a1 req-b641017b-9b02-4050-a580-87306bd8e98e service nova] Enqueued Resource ID: 52873450-f314-4110-a316-7380569e0afe with Priority: HIGHEST for action port [ 720.540579] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_rules [ 720.540716] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 720.540813] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52873450-f314-4110-a316-7380569e0afe with Priority: HIGHEST for action port [ 720.541379] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.541497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.541807] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.541807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.542009] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-52873450-f314-4110-a316-7380569e0afe taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.542113] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52873450-f314-4110-a316-7380569e0afe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.542152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52873450-f314-4110-a316-7380569e0afe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.542451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52873450-f314-4110-a316-7380569e0afe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.542535] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52873450-f314-4110-a316-7380569e0afe',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.803939] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.804877] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e19a668-bcb8-48c2-b8b7-65bda673e4bb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.871162] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.871363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.871542] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.871629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.871796] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41ad83e5-4645-4e91-a223-473eefb69c38 with status ACTIVE [ 720.871957] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.872078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.872142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.872365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.872464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.872660] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.872760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.872822] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.872996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.873096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.873281] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.873662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.873662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.873662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.873662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.873841] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41ad83e5-4645-4e91-a223-473eefb69c38 is going to be updated. [ 720.896902] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.897097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.897151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.897688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.897688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.897816] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.018858] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.045743] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52873450-f314-4110-a316-7380569e0afe with status ACTIVE [ 721.046282] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.046282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.046282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.046582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.046737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.047047] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.047183] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.047249] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.047523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.047523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.047723] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.047823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.047885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.048352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.048352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.048352] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52873450-f314-4110-a316-7380569e0afe is going to be updated. [ 721.075304] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.075636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.075735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.076134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.076332] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.076552] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52873450-f314-4110-a316-7380569e0afe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.309420] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.310504] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e19a668-bcb8-48c2-b8b7-65bda673e4bb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.428987] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 721.429973] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.521603] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.522426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.522426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.522426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.522426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.522426] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd is going to be updated. [ 721.562707] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.562896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.562981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.563237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.563404] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.574778] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: IN_PROGRESS for 2s [ 721.610573] env[65102]: INFO networking_nsxv3.common.synchronization [req-d506689e-3281-4fe5-9b40-e844c36c7fe0 req-0f900cd0-8092-48e9-baf6-4f0f8a748399 tempest-ServerRescueTestJSONUnderV235-1815693667 tempest-ServerRescueTestJSONUnderV235-1815693667-project-member] Enqueued Resource ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb with Priority: HIGHEST for action security_group_members [ 721.610573] env[65102]: INFO networking_nsxv3.common.synchronization [req-d506689e-3281-4fe5-9b40-e844c36c7fe0 req-0f900cd0-8092-48e9-baf6-4f0f8a748399 tempest-ServerRescueTestJSONUnderV235-1815693667 tempest-ServerRescueTestJSONUnderV235-1815693667-project-member] Enqueued Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_members [ 721.610573] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb with Priority: HIGHEST for action security_group_members [ 721.610573] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_members [ 721.610573] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.610573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.611596] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.611596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.660359] env[65102]: INFO networking_nsxv3.common.synchronization [req-d506689e-3281-4fe5-9b40-e844c36c7fe0 req-0f900cd0-8092-48e9-baf6-4f0f8a748399 tempest-ServerRescueTestJSONUnderV235-1815693667 tempest-ServerRescueTestJSONUnderV235-1815693667-project-member] Enqueued Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_rules [ 721.662255] env[65102]: INFO networking_nsxv3.common.synchronization [req-d506689e-3281-4fe5-9b40-e844c36c7fe0 req-0f900cd0-8092-48e9-baf6-4f0f8a748399 tempest-ServerRescueTestJSONUnderV235-1815693667 tempest-ServerRescueTestJSONUnderV235-1815693667-project-member] Enqueued Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_members [ 721.662255] env[65102]: INFO networking_nsxv3.common.synchronization [req-d506689e-3281-4fe5-9b40-e844c36c7fe0 req-0f900cd0-8092-48e9-baf6-4f0f8a748399 tempest-ServerRescueTestJSONUnderV235-1815693667 tempest-ServerRescueTestJSONUnderV235-1815693667-project-member] Enqueued Resource ID: 41ad83e5-4645-4e91-a223-473eefb69c38 with Priority: HIGHEST for action port [ 721.662255] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_rules [ 721.662255] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_members [ 721.662255] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41ad83e5-4645-4e91-a223-473eefb69c38 with Priority: HIGHEST for action port [ 721.662255] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.662255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.662529] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.662529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.662716] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-41ad83e5-4645-4e91-a223-473eefb69c38 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.662783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.662892] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.663206] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.663206] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41ad83e5-4645-4e91-a223-473eefb69c38',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.812779] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.813057] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.813057] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.814132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.814132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.814132] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 is going to be updated. [ 721.815660] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.815833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.815833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.816110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.816243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.816314] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb is going to be created. [ 721.841726] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.841879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.841946] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.842185] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.842346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.848041] env[65102]: INFO networking_nsxv3.common.synchronization [req-c26afe59-999a-4856-9bac-1214df9ff3d9 req-f475fa52-0f68-45cf-b585-812be895fde2 tempest-ServerDiagnosticsTest-914305661 tempest-ServerDiagnosticsTest-914305661-project-member] Enqueued Resource ID: 44148911-e2d1-4130-8398-a96a2ea96086 with Priority: HIGHEST for action security_group_members [ 721.849209] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.849364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.849481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.849946] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.849946] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.851308] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44148911-e2d1-4130-8398-a96a2ea96086 with Priority: HIGHEST for action security_group_members [ 721.851736] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-44148911-e2d1-4130-8398-a96a2ea96086 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.851972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.852083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.852352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.852577] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.852719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.852919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.853012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.853132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.853258] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44148911-e2d1-4130-8398-a96a2ea96086',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.857970] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb in Status: UNINITIALIZED for 2s [ 721.861204] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: IN_PROGRESS for 2s [ 722.164932] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41ad83e5-4645-4e91-a223-473eefb69c38 with status ACTIVE [ 722.165322] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.165738] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.165965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.166358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.166566] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.169918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.169918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.169918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.169918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.169918] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.169918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.169918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.169918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.169918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.169918] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41ad83e5-4645-4e91-a223-473eefb69c38 is going to be updated. [ 722.213744] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.213744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.213744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.213744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.213744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.213744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41ad83e5-4645-4e91-a223-473eefb69c38" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.359966] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.360272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.360272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.360472] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.360587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.360804] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.360924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.360978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.361125] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.361513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.361513] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44148911-e2d1-4130-8398-a96a2ea96086 already deleted. [ 722.361513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.399042] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.399042] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.399317] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.399578] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.399923] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.400144] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.400275] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.400588] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.400804] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.401173] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.401350] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.401689] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.401751] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.401958] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.402037] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.402205] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.436871] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.437161] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 722.437377] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.438549] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.438700] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-454bd66e-49a9-4417-869d-fb1c0f08d472 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.438881] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-454bd66e-49a9-4417-869d-fb1c0f08d472" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.439052] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-454bd66e-49a9-4417-869d-fb1c0f08d472" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.439537] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-454bd66e-49a9-4417-869d-fb1c0f08d472" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.439773] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('454bd66e-49a9-4417-869d-fb1c0f08d472',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.942689] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.943139] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.943139] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.943716] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.943961] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.944135] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 454bd66e-49a9-4417-869d-fb1c0f08d472 not found, creating... [ 722.944455] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.944682] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.944814] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.945093] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.945263] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.945645] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.945883] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.946017] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.946341] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.946532] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.946830] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 454bd66e-49a9-4417-869d-fb1c0f08d472 is going to be created. [ 722.972846] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.973196] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.973344] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.973646] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.973913] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.974162] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-454bd66e-49a9-4417-869d-fb1c0f08d472" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.589325] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: SUCCESS [ 723.590225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.590225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.590344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.590695] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.590695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.590863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.591099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.591470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.591470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.591559] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.592608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.592808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.593170] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.593244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.593330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.593495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.593581] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.593672] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.689079] env[65102]: INFO networking_nsxv3.common.synchronization [req-c26afe59-999a-4856-9bac-1214df9ff3d9 req-5190ff72-c414-42dc-8829-7c4a9942cf2b service nova] Enqueued Resource ID: 44148911-e2d1-4130-8398-a96a2ea96086 with Priority: HIGHEST for action security_group_rules [ 723.689323] env[65102]: INFO networking_nsxv3.common.synchronization [req-c26afe59-999a-4856-9bac-1214df9ff3d9 req-5190ff72-c414-42dc-8829-7c4a9942cf2b service nova] Enqueued Resource ID: 44148911-e2d1-4130-8398-a96a2ea96086 with Priority: HIGHEST for action security_group_members [ 723.689737] env[65102]: INFO networking_nsxv3.common.synchronization [req-c26afe59-999a-4856-9bac-1214df9ff3d9 req-5190ff72-c414-42dc-8829-7c4a9942cf2b service nova] Enqueued Resource ID: 454bd66e-49a9-4417-869d-fb1c0f08d472 with Priority: HIGHEST for action port [ 723.690500] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44148911-e2d1-4130-8398-a96a2ea96086 with Priority: HIGHEST for action security_group_rules [ 723.690648] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44148911-e2d1-4130-8398-a96a2ea96086 with Priority: HIGHEST for action security_group_members [ 723.690788] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 454bd66e-49a9-4417-869d-fb1c0f08d472 with Priority: HIGHEST for action port [ 723.691123] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44148911-e2d1-4130-8398-a96a2ea96086 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.691284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.691380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.691661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.691783] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44148911-e2d1-4130-8398-a96a2ea96086',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.693453] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-44148911-e2d1-4130-8398-a96a2ea96086 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.693453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.693453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.693453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.693453] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.693453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.693453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.695250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.695657] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.695778] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44148911-e2d1-4130-8398-a96a2ea96086',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.696784] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-454bd66e-49a9-4417-869d-fb1c0f08d472 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.696898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-454bd66e-49a9-4417-869d-fb1c0f08d472" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.696965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-454bd66e-49a9-4417-869d-fb1c0f08d472" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.697141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-454bd66e-49a9-4417-869d-fb1c0f08d472" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.697225] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('454bd66e-49a9-4417-869d-fb1c0f08d472',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.870685] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb in Status: SUCCESS [ 723.870923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.870973] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.871280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.871525] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.871700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.871805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.872390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.872568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.872716] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e19a668-bcb8-48c2-b8b7-65bda673e4bb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.874954] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: SUCCESS [ 723.874954] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.875103] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.875263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.875493] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.875562] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.875620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.875805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.875956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.875987] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.095921] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.096399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.096750] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.200592] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-44148911-e2d1-4130-8398-a96a2ea96086 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.200780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.201118] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 454bd66e-49a9-4417-869d-fb1c0f08d472 with status ACTIVE [ 724.203350] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.203350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.203350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.203350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.203350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.203350] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.203350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.203350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.203668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.203668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.204038] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.204143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.204209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.204375] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.204677] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.204677] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 454bd66e-49a9-4417-869d-fb1c0f08d472 is going to be updated. [ 724.205878] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44148911-e2d1-4130-8398-a96a2ea96086',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.234332] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.234522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.234600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.234808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.234930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.235537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-454bd66e-49a9-4417-869d-fb1c0f08d472" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.380911] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.380911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.380911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.380911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.380911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.380911] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.380911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.380911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.380911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.380911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.380911] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb is going to be deleted. [ 724.382351] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.446576] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.446713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.446775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.447012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.447110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.447210] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.447368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.447520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.447688] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.447788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.447843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.448537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.448537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.448537] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e19a668-bcb8-48c2-b8b7-65bda673e4bb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.599436] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.714794] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44148911-e2d1-4130-8398-a96a2ea96086',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.886597] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.951352] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.951982] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.952259] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.952708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.952850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.953513] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.953513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.953513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.953513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.953762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.953762] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb already deleted. [ 724.953762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.954467] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e19a668-bcb8-48c2-b8b7-65bda673e4bb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.957132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.957132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.957467] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.961854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.961854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.961854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.961854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.961854] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e19a668-bcb8-48c2-b8b7-65bda673e4bb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.102475] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.102875] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.102875] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.102978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.103042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.103125] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd is going to be updated. [ 725.139202] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.139431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.139510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.139758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.139916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.151063] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: IN_PROGRESS for 2s [ 725.221818] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.221818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.221818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.221818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.221818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.221818] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44148911-e2d1-4130-8398-a96a2ea96086 is going to be created. [ 725.257446] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.257446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.257446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.257446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.257446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.268024] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44148911-e2d1-4130-8398-a96a2ea96086 in Status: UNINITIALIZED for 2s [ 725.392083] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.392353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.392455] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.392776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.392875] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.392989] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 is going to be updated. [ 725.432636] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.432865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.433032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.433318] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.433576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.448177] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: IN_PROGRESS for 2s [ 725.456995] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e19a668-bcb8-48c2-b8b7-65bda673e4bb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.461352] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.461579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.461652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.461823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.461949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.462133] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.462651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.462651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.462651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.462651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.462651] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb already deleted. [ 725.462841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.960023] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e19a668-bcb8-48c2-b8b7-65bda673e4bb: rpc.has_security_group_logging(os_id): False [ 725.983399] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.983734] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.983734] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.983969] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.984078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.984325] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.984433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.984501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.984754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.984825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.984920] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb is going to be created. [ 726.006240] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9e19a668-bcb8-48c2-b8b7-65bda673e4bb], does not exist path=[/infra/domains/default/groups/9e19a668-bcb8-48c2-b8b7-65bda673e4bb]."\n}' [ 726.006471] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9e19a668-bcb8-48c2-b8b7-65bda673e4bb [ 726.006690] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 726.040891] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.040891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.040891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.041526] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.042797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.043388] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.043618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.043705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.043974] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.044134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.044453] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.044816] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.044972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.045235] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.045376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.045520] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e19a668-bcb8-48c2-b8b7-65bda673e4bb is going to be created. [ 726.067037] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9e19a668-bcb8-48c2-b8b7-65bda673e4bb], does not exist path=[/infra/domains/default/groups/9e19a668-bcb8-48c2-b8b7-65bda673e4bb]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9e19a668-bcb8-48c2-b8b7-65bda673e4bb [ 726.067322] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e19a668-bcb8-48c2-b8b7-65bda673e4bb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.067891] env[65102]: Traceback (most recent call last): [ 726.067891] env[65102]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 726.067891] env[65102]: return func(*args, **kwargs) [ 726.067891] env[65102]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 726.067891] env[65102]: res.raise_for_status() [ 726.068224] env[65102]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 726.068224] env[65102]: raise HTTPError(http_error_msg, response=self) [ 726.068224] env[65102]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9e19a668-bcb8-48c2-b8b7-65bda673e4bb [ 726.068224] env[65102]: During handling of the above exception, another exception occurred: [ 726.068224] env[65102]: Traceback (most recent call last): [ 726.068224] env[65102]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 726.068224] env[65102]: listener.cb(fileno) [ 726.068224] env[65102]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 726.068224] env[65102]: result = function(*args, **kwargs) [ 726.068224] env[65102]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 726.068224] env[65102]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 726.068224] env[65102]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 726.068224] env[65102]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 726.068224] env[65102]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 726.068224] env[65102]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 726.068224] env[65102]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 726.068224] env[65102]: res.raise_for_status() [ 726.068224] env[65102]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 726.068224] env[65102]: raise HTTPError(http_error_msg, response=self) [ 726.068224] env[65102]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9e19a668-bcb8-48c2-b8b7-65bda673e4bb [ 726.068224] env[65102]: Removing descriptor: 16 [ 726.392665] env[65102]: INFO networking_nsxv3.common.synchronization [req-db294772-424d-484c-a756-830af9cb97ac req-d3a7ca50-88b9-4d48-bae5-553bb1429595 tempest-AttachInterfacesV270Test-1992497490 tempest-AttachInterfacesV270Test-1992497490-project-member] Enqueued Resource ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 with Priority: HIGHEST for action security_group_members [ 726.393113] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 with Priority: HIGHEST for action security_group_members [ 726.393395] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4563a809-6b5f-4203-a94d-ff2468059ed7 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.393518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.395367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.395367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.395367] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.395367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.395367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.395367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.395367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.395367] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4563a809-6b5f-4203-a94d-ff2468059ed7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.823425] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-767 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.824296] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-767" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.824689] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-767" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.825142] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-767" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.825554] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.825873] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.826373] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.826698] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.826958] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.827270] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.827561] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.827764] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.827966] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.828192] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.828507] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.828865] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.849310] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.849656] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 726.850356] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.850356] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-767" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.850841] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-b3b4ec0d-49c0-4c0a-845c-157dd80604fb taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.851178] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-b3b4ec0d-49c0-4c0a-845c-157dd80604fb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.852020] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-b3b4ec0d-49c0-4c0a-845c-157dd80604fb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.852020] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-b3b4ec0d-49c0-4c0a-845c-157dd80604fb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.852020] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3b4ec0d-49c0-4c0a-845c-157dd80604fb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.900074] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.900257] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.900331] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.900713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.900781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.901204] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.901204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.901328] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.901885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.901885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.901994] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 already deleted. [ 726.902053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.164746] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: SUCCESS [ 727.166766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.166766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.167154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.167360] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.167482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.167552] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.168690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.168785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.168897] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.278045] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44148911-e2d1-4130-8398-a96a2ea96086 in Status: SUCCESS [ 727.278294] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.278465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.278686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.278882] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.279011] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.279081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.279236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.279316] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.279397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.279485] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44148911-e2d1-4130-8398-a96a2ea96086',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.357029] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.357029] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.357029] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.357029] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.357029] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.357029] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port b3b4ec0d-49c0-4c0a-845c-157dd80604fb not found, creating... [ 727.357029] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.357029] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.357029] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.357029] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.357029] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.357603] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.357603] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.357603] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.357603] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.357603] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.358016] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: b3b4ec0d-49c0-4c0a-845c-157dd80604fb is going to be created. [ 727.385516] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.385516] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.388175] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.388175] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.388175] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.388175] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-b3b4ec0d-49c0-4c0a-845c-157dd80604fb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.471081] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: SUCCESS [ 727.471081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.471081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.471435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.471476] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.471604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.471653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.471787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.471891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.471970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.472082] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.473714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.473896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.474459] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.474459] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.474459] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.474459] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.474667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.474667] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.672635] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.782993] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-44148911-e2d1-4130-8398-a96a2ea96086 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.783150] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.783245] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.783533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.783722] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.783839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.783894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.784107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.784173] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.784241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.784395] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-44148911-e2d1-4130-8398-a96a2ea96086 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.784479] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.784531] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.784688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.784843] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.784941] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.784993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.785165] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.785243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.785388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.785430] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44148911-e2d1-4130-8398-a96a2ea96086',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.977785] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.977785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.977960] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.178287] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.234178] env[65102]: INFO networking_nsxv3.common.synchronization [req-db294772-424d-484c-a756-830af9cb97ac req-1fe98ff3-fbbe-4e56-907d-b00497f67c01 service nova] Enqueued Resource ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 with Priority: HIGHEST for action security_group_rules [ 728.234393] env[65102]: INFO networking_nsxv3.common.synchronization [req-db294772-424d-484c-a756-830af9cb97ac req-1fe98ff3-fbbe-4e56-907d-b00497f67c01 service nova] Enqueued Resource ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 with Priority: HIGHEST for action security_group_members [ 728.234550] env[65102]: INFO networking_nsxv3.common.synchronization [req-db294772-424d-484c-a756-830af9cb97ac req-1fe98ff3-fbbe-4e56-907d-b00497f67c01 service nova] Enqueued Resource ID: b3b4ec0d-49c0-4c0a-845c-157dd80604fb with Priority: HIGHEST for action port [ 728.235654] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 with Priority: HIGHEST for action security_group_rules [ 728.235774] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 with Priority: HIGHEST for action security_group_members [ 728.235898] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3b4ec0d-49c0-4c0a-845c-157dd80604fb with Priority: HIGHEST for action port [ 728.236224] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4563a809-6b5f-4203-a94d-ff2468059ed7 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.236353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.236450] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.236707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.236823] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4563a809-6b5f-4203-a94d-ff2468059ed7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.238206] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4563a809-6b5f-4203-a94d-ff2468059ed7 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.238324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.238391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.238600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.238758] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.238855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.238940] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.239112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.239201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.239340] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4563a809-6b5f-4203-a94d-ff2468059ed7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.240125] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3b4ec0d-49c0-4c0a-845c-157dd80604fb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.240223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3b4ec0d-49c0-4c0a-845c-157dd80604fb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.240295] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3b4ec0d-49c0-4c0a-845c-157dd80604fb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.240445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3b4ec0d-49c0-4c0a-845c-157dd80604fb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.240548] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3b4ec0d-49c0-4c0a-845c-157dd80604fb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.291181] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44148911-e2d1-4130-8398-a96a2ea96086: rpc.has_security_group_logging(os_id): False [ 728.314783] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.314783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.314783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.315046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.315090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.315448] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.315448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.315638] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.315745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.315809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.316013] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.316114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.316180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.316567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.316567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.316567] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.316752] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.316752] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.317116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.317116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.317116] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44148911-e2d1-4130-8398-a96a2ea96086 is going to be created. [ 728.416157] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.416157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.416157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.416157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.416157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.432976] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44148911-e2d1-4130-8398-a96a2ea96086 in Status: IN_PROGRESS for 2s [ 728.480681] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.681995] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.682367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.682367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.682506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.682552] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.682695] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd is going to be updated. [ 728.718355] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.718560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.718791] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.719335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.719612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.730198] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: IN_PROGRESS for 2s [ 728.743050] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4563a809-6b5f-4203-a94d-ff2468059ed7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.744755] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4563a809-6b5f-4203-a94d-ff2468059ed7 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.745022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.745208] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3b4ec0d-49c0-4c0a-845c-157dd80604fb with status ACTIVE [ 728.745481] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.745643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.745643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.745861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.745999] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.746200] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.746299] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.747391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.747391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.747391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.747391] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.747391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.747391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.747391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.747391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.747391] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3b4ec0d-49c0-4c0a-845c-157dd80604fb is going to be updated. [ 728.777284] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.777489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.777489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.777708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.777919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.778054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3b4ec0d-49c0-4c0a-845c-157dd80604fb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.983567] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.983743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.983788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.984045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.984099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.984200] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 is going to be updated. [ 729.021852] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.021852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.021852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.021852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.021852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.031464] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: IN_PROGRESS for 2s [ 729.254859] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4563a809-6b5f-4203-a94d-ff2468059ed7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.760842] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.761350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.761350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.761350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.761350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.761563] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 is going to be created. [ 729.795261] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.795487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.795598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.795901] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.796159] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.809469] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 in Status: UNINITIALIZED for 2s [ 730.161515] env[65102]: INFO networking_nsxv3.common.synchronization [req-041568a7-927f-4cdd-a903-15b97e7c618c req-d189a6c7-e464-4e16-b775-72a4cd290637 tempest-ImagesOneServerTestJSON-2092730972 tempest-ImagesOneServerTestJSON-2092730972-project-member] Enqueued Resource ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec with Priority: HIGHEST for action security_group_members [ 730.162130] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec with Priority: HIGHEST for action security_group_members [ 730.162439] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.162559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.162632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.162911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.163143] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.163264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.163456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.163525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.163604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.163697] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e67ea8b7-f278-4fbd-ba09-b18599f6e8ec',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.446487] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44148911-e2d1-4130-8398-a96a2ea96086 in Status: SUCCESS [ 730.447043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.667287] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.667287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.667287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.667287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.691272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.691272] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.691272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.691272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.691272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.691272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.691272] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec is going to be updated. [ 730.720282] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.720444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.720521] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.720729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.720880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.730164] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec in Status: IN_PROGRESS for 2s [ 730.741204] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: SUCCESS [ 730.741409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.741583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.742313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.742313] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.742313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.742313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.742313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.742540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.742540] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.043225] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: SUCCESS [ 731.043591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.044345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.045595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.045595] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.045745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.045745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.046016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.046159] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.046328] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.246108] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.551314] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.749313] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.821885] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 in Status: SUCCESS [ 731.822180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.822377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.822590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.822789] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.822910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.822975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.823269] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.823384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.823494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.823607] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4563a809-6b5f-4203-a94d-ff2468059ed7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.054749] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.255116] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.255387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.256075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.256075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.256075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.256075] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd is going to be updated. [ 732.317304] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.317481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.317547] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.317811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.317924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.325723] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4563a809-6b5f-4203-a94d-ff2468059ed7 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.325968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.326043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.326607] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.326886] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.327012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.327195] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.327408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.327506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.327599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.327981] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4563a809-6b5f-4203-a94d-ff2468059ed7 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.327981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.327981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.328142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.328263] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.328322] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.328322] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.328679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.328764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.328862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.328958] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4563a809-6b5f-4203-a94d-ff2468059ed7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.337677] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: IN_PROGRESS for 2s [ 732.560809] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.560809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.560809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.560809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.560809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.560809] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 is going to be updated. [ 732.593701] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.595717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.595862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.596633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.596633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.606662] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: IN_PROGRESS for 2s [ 732.742062] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec in Status: SUCCESS [ 732.742062] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec deletion is rescheduled due to dependency. [ 732.742062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.834548] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4563a809-6b5f-4203-a94d-ff2468059ed7: rpc.has_security_group_logging(os_id): False [ 732.860027] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.860027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.860027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.860027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.860027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.860027] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.860027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.860027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.860027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.860027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.860027] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.860027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.860027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.860027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.860027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.860689] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.860689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.860689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.860689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.860986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.861202] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 is going to be created. [ 732.932499] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.932644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.932707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.934185] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.934185] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.950809] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 in Status: IN_PROGRESS for 2s [ 733.418234] env[65102]: INFO networking_nsxv3.common.synchronization [None req-51bbdde2-9084-4427-a16c-4cceedc4ca42 None None] Enqueued Resource ID: 9772aa1e-99b6-4acb-8b54-c2a1eede51da with Priority: HIGHEST for action port [ 733.419710] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9772aa1e-99b6-4acb-8b54-c2a1eede51da with Priority: HIGHEST for action port [ 733.419974] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-9772aa1e-99b6-4acb-8b54-c2a1eede51da taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.420290] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9772aa1e-99b6-4acb-8b54-c2a1eede51da" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.420290] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9772aa1e-99b6-4acb-8b54-c2a1eede51da" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.420984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9772aa1e-99b6-4acb-8b54-c2a1eede51da" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.421210] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9772aa1e-99b6-4acb-8b54-c2a1eede51da',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.925185] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9772aa1e-99b6-4acb-8b54-c2a1eede51da [ 733.925185] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.925807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.925807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.926718] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.926718] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.926867] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9772aa1e-99b6-4acb-8b54-c2a1eede51da already deleted. [ 733.927729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9772aa1e-99b6-4acb-8b54-c2a1eede51da" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.356558] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: SUCCESS [ 734.357257] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.359801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.360936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.361407] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.364496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.364496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.364496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.364842] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.366189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.367777] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.367777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.367777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.367777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.368026] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.368026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.368144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.368415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.368569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.368707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.368860] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.618688] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: SUCCESS [ 734.619026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.620104] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.620288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.620535] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.620692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.620781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.620978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.621111] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.621369] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.621551] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.621655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.621718] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.621927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.622114] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.622241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.622323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.622480] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.622563] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.622644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.622738] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.875562] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e4d0983-93de-4906-b7b5-69591bafe0fd: rpc.has_security_group_logging(os_id): False [ 734.903022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.903190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.903253] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.903469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.903566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.903767] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.903858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.903914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.904151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.904271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.904411] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.904489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.904572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.905458] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.905585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.905994] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.905994] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.905994] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.906756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.906818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.907446] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd is going to be created. [ 734.969347] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 in Status: SUCCESS [ 734.969347] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.988546] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.990044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.990044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.990044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.990044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.004221] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: IN_PROGRESS for 2s [ 735.125764] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04d8d678-ef4e-4987-a57b-b8f1a69f0a59: rpc.has_security_group_logging(os_id): False [ 735.171651] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.175019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.175019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.175019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.203248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.203248] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.203248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.203248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.203640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.203640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.203971] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.203971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.204141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.204402] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.204402] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.204528] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.204764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.204764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.204893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.207272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.207272] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 is going to be updated. [ 735.309215] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.309215] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.309215] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.310467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.310467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.327886] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: IN_PROGRESS for 2s [ 735.510028] env[65102]: INFO networking_nsxv3.common.synchronization [req-3c339fa5-3483-4871-a366-f6acf4e5b619 req-28652af0-c631-4dce-a238-46ee52b63d99 tempest-ServersTestJSON-86747762 tempest-ServersTestJSON-86747762-project-member] Enqueued Resource ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b with Priority: HIGHEST for action security_group_members [ 735.511262] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b with Priority: HIGHEST for action security_group_members [ 735.511442] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-db36f333-73a7-4f6b-973f-e0c1b1ed809b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.511553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.512313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.512313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.512313] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.512313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.512313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.512621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.512621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.512695] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db36f333-73a7-4f6b-973f-e0c1b1ed809b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.864684] env[65102]: INFO networking_nsxv3.common.synchronization [req-3e1748b3-2a8c-4b64-978d-0aad167d1ca5 req-5f27435b-29be-4c1c-88d6-0758573ca248 tempest-SecurityGroupRulesTestJSON-1107260444 tempest-SecurityGroupRulesTestJSON-1107260444-project-member] Enqueued Resource ID: 0ba46622-1aab-45ea-ba02-32c8975f778c with Priority: HIGHEST for action security_group_rules [ 735.867893] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ba46622-1aab-45ea-ba02-32c8975f778c with Priority: HIGHEST for action security_group_rules [ 735.868743] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ba46622-1aab-45ea-ba02-32c8975f778c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.868868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ba46622-1aab-45ea-ba02-32c8975f778c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.868938] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ba46622-1aab-45ea-ba02-32c8975f778c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.869728] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ba46622-1aab-45ea-ba02-32c8975f778c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.869728] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ba46622-1aab-45ea-ba02-32c8975f778c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.938307] env[65102]: INFO networking_nsxv3.common.synchronization [req-ef147d34-69b3-4d17-bc79-ff456c12eba3 req-0f93fc4b-7236-42c6-9dd2-28e2c469c8be tempest-ListServersNegativeTestJSON-1289631193 tempest-ListServersNegativeTestJSON-1289631193-project-member] Enqueued Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 735.938949] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 735.939570] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.939810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.939895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.940404] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.940703] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.940956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.941118] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.941343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.941449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.941554] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.015774] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.016146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.016213] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.017049] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.039898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.040190] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.042569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.042569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.042764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.042911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.043250] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b is going to be updated. [ 736.076944] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.078619] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.078619] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.078619] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.078619] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.100465] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b in Status: IN_PROGRESS for 2s [ 736.394530] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.394530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.394530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.394530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.394530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.394530] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ba46622-1aab-45ea-ba02-32c8975f778c already deleted. [ 736.394530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ba46622-1aab-45ea-ba02-32c8975f778c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.444703] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.659423] env[65102]: INFO networking_nsxv3.common.synchronization [None req-6ea242f2-077d-490f-aed0-681f94742a4b None None] Enqueued Resource ID: b28fd022-4a51-48ca-8ac0-dd2d59f6012a with Priority: HIGHEST for action port [ 736.659713] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b28fd022-4a51-48ca-8ac0-dd2d59f6012a with Priority: HIGHEST for action port [ 736.659902] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b28fd022-4a51-48ca-8ac0-dd2d59f6012a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.659902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b28fd022-4a51-48ca-8ac0-dd2d59f6012a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.660040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b28fd022-4a51-48ca-8ac0-dd2d59f6012a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.661755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b28fd022-4a51-48ca-8ac0-dd2d59f6012a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.661893] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b28fd022-4a51-48ca-8ac0-dd2d59f6012a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.949896] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.025224] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: SUCCESS [ 737.025624] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.027314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.027314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.027314] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.098635] env[65102]: INFO networking_nsxv3.common.synchronization [req-cddec31d-d80c-49f9-9924-c042a54c6f62 req-51900231-6553-4ef7-aa40-0d671fbb0e9c tempest-MigrationsAdminTest-673773847 tempest-MigrationsAdminTest-673773847-project-member] Enqueued Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_members [ 737.099815] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_members [ 737.100286] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.100545] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.100545] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.101088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.101088] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.101088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.101088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.101088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.101088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.101325] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.164761] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b28fd022-4a51-48ca-8ac0-dd2d59f6012a [ 737.164761] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.164761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.164761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.164761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.164923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.165050] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b28fd022-4a51-48ca-8ac0-dd2d59f6012a already deleted. [ 737.165143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b28fd022-4a51-48ca-8ac0-dd2d59f6012a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.242498] env[65102]: INFO networking_nsxv3.common.synchronization [req-f2d1b03b-da5c-4c7b-abc1-124064a3cd1b req-3daa085d-c4cb-46d8-b925-e359a2357f75 tempest-ServerRescueTestJSONUnderV235-1815693667 tempest-ServerRescueTestJSONUnderV235-1815693667-project-member] Enqueued Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_members [ 737.243136] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 with Priority: HIGHEST for action security_group_members [ 737.243802] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.243802] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.243802] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.243983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.244453] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.244657] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.244807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.245097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.245291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.245475] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.347715] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: SUCCESS [ 737.347962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.348546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.348766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.348861] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04d8d678-ef4e-4987-a57b-b8f1a69f0a59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.452591] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.452774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.452774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.453570] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.453570] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.453570] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd is going to be updated. [ 737.500614] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.500614] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.500614] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.500797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.500797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.504750] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.505937] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.505937] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.506248] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.506556] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.506806] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.506867] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.508278] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.508508] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.509268] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.509390] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.509508] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.509611] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.509875] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.509875] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.509987] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.512824] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: IN_PROGRESS for 2s [ 737.532311] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.532311] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 737.532311] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.532440] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.533327] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-fcca9afe-edba-479c-93f6-1310627d946f taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.533327] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-fcca9afe-edba-479c-93f6-1310627d946f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.533327] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-fcca9afe-edba-479c-93f6-1310627d946f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.533579] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-fcca9afe-edba-479c-93f6-1310627d946f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.533726] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcca9afe-edba-479c-93f6-1310627d946f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.534783] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.534893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.566375] env[65102]: INFO networking_nsxv3.common.synchronization [req-b863afd9-dc86-47d9-ba64-1a85f9064351 req-bf232b28-7151-4539-ae3a-26263a18aea2 tempest-SecurityGroupRulesTestJSON-1107260444 tempest-SecurityGroupRulesTestJSON-1107260444-project-member] Enqueued Resource ID: e3259577-379b-4ab7-ac1d-06d16b25ac23 with Priority: HIGHEST for action security_group_rules [ 737.567655] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3259577-379b-4ab7-ac1d-06d16b25ac23 with Priority: HIGHEST for action security_group_rules [ 737.567655] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3259577-379b-4ab7-ac1d-06d16b25ac23 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.567655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3259577-379b-4ab7-ac1d-06d16b25ac23" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.569336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3259577-379b-4ab7-ac1d-06d16b25ac23" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.569336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3259577-379b-4ab7-ac1d-06d16b25ac23" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.569336] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3259577-379b-4ab7-ac1d-06d16b25ac23',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.604627] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.748408] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.748572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.748641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.748852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.748944] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.749155] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.749250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.749371] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.750378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.750378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.750378] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 is going to be updated. [ 737.776517] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.776656] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.776771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.776939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.777108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.787532] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: IN_PROGRESS for 2s [ 737.880954] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.881170] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.881247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.881529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.881628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.881725] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 is going to be deleted. [ 737.954077] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.954077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.954077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.954077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.954077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.954077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.040453] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.041418] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.041418] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.041647] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.042972] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.043325] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port fcca9afe-edba-479c-93f6-1310627d946f not found, creating... [ 738.045088] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.045256] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.048221] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.048221] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.048221] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.048221] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.048221] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.048221] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.048221] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.048699] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.048699] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: fcca9afe-edba-479c-93f6-1310627d946f is going to be created. [ 738.086512] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.086778] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.086848] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.087173] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.087416] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.087641] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-fcca9afe-edba-479c-93f6-1310627d946f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.090627] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.090765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.090813] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.091038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.091145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.091238] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3259577-379b-4ab7-ac1d-06d16b25ac23 already deleted. [ 738.091360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3259577-379b-4ab7-ac1d-06d16b25ac23" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.108533] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.117427] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b in Status: SUCCESS [ 738.117715] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b deletion is rescheduled due to dependency. [ 738.117890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.611723] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.611878] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.611974] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.612227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.612292] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.612375] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 is going to be updated. [ 738.641182] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.641323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.641367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.641541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.641708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.650969] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: IN_PROGRESS for 2s [ 738.777122] env[65102]: INFO networking_nsxv3.common.synchronization [req-34c104bc-34d1-4a35-afdd-53cb78b8a6e0 req-f989a6d9-c6ac-40a1-a35a-340bfc786634 tempest-ServerDiagnosticsTest-914305661 tempest-ServerDiagnosticsTest-914305661-project-member] Enqueued Resource ID: 44148911-e2d1-4130-8398-a96a2ea96086 with Priority: HIGHEST for action security_group_members [ 738.777649] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44148911-e2d1-4130-8398-a96a2ea96086 with Priority: HIGHEST for action security_group_members [ 738.777943] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-44148911-e2d1-4130-8398-a96a2ea96086 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.778123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.778201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.778390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.778559] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.778631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.778695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.778840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.778925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.779026] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44148911-e2d1-4130-8398-a96a2ea96086',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.804118] env[65102]: INFO networking_nsxv3.common.synchronization [req-cddec31d-d80c-49f9-9924-c042a54c6f62 req-de35f747-4b98-428b-b114-bdf9bdca6c35 service nova] Enqueued Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_rules [ 738.804198] env[65102]: INFO networking_nsxv3.common.synchronization [req-cddec31d-d80c-49f9-9924-c042a54c6f62 req-de35f747-4b98-428b-b114-bdf9bdca6c35 service nova] Enqueued Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_members [ 738.804347] env[65102]: INFO networking_nsxv3.common.synchronization [req-cddec31d-d80c-49f9-9924-c042a54c6f62 req-de35f747-4b98-428b-b114-bdf9bdca6c35 service nova] Enqueued Resource ID: fcca9afe-edba-479c-93f6-1310627d946f with Priority: HIGHEST for action port [ 738.805074] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_rules [ 738.805495] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_members [ 738.805495] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcca9afe-edba-479c-93f6-1310627d946f with Priority: HIGHEST for action port [ 738.805776] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.805925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.805996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.806193] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.806280] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.807114] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.807211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.807399] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcca9afe-edba-479c-93f6-1310627d946f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.807508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcca9afe-edba-479c-93f6-1310627d946f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.807580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcca9afe-edba-479c-93f6-1310627d946f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.807740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcca9afe-edba-479c-93f6-1310627d946f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.807813] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcca9afe-edba-479c-93f6-1310627d946f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.180779] env[65102]: INFO networking_nsxv3.common.synchronization [req-80cc2627-b323-4d58-8127-a9fb775d9c5f req-343bdd48-3dcb-40fd-b67d-a803cd99b949 tempest-ServerActionsV293TestJSON-238779998 tempest-ServerActionsV293TestJSON-238779998-project-member] Enqueued Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGHEST for action security_group_members [ 739.181909] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGHEST for action security_group_members [ 739.182397] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c61af5d-d112-491b-97cd-9e037a2e5189 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.182582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.182699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.183023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.183214] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.183350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.183414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.183596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.183704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.185196] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c61af5d-d112-491b-97cd-9e037a2e5189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.282324] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.283330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.283330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.283330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.283330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.283573] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.283672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.283743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.283866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.283945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.284046] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44148911-e2d1-4130-8398-a96a2ea96086 is going to be updated. [ 739.310803] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.310803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.312917] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcca9afe-edba-479c-93f6-1310627d946f with status ACTIVE [ 739.315839] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.315839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.315839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.315839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.315839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.315839] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.315839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.315839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.315839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.315839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.315839] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.315839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.315839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.315839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.315839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.315839] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcca9afe-edba-479c-93f6-1310627d946f is going to be updated. [ 739.328098] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.328346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.328436] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.328651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.328821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.340277] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44148911-e2d1-4130-8398-a96a2ea96086 in Status: IN_PROGRESS for 2s [ 739.347551] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.347890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.347890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.348155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.348484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.348614] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcca9afe-edba-479c-93f6-1310627d946f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.523330] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: SUCCESS [ 739.523588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.523747] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.523989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.524240] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.524365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.524434] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.524600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.524705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.524767] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.524858] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.555919] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.556136] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-11" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.556239] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-11" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.556591] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-11" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.557236] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.557236] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.557236] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.557456] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.557622] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.557829] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.557941] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.558060] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.558168] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.558276] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.558379] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.558507] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.581418] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.581588] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.581721] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.581894] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-11" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.582220] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-33799b3d-5ade-4cb0-ae83-3d00bfd972ca taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.582387] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-33799b3d-5ade-4cb0-ae83-3d00bfd972ca" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.582541] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-33799b3d-5ade-4cb0-ae83-3d00bfd972ca" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.582809] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-33799b3d-5ade-4cb0-ae83-3d00bfd972ca" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.582949] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33799b3d-5ade-4cb0-ae83-3d00bfd972ca',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.687159] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.687420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.687588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.687874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.688055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.688301] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.688481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.688584] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.688843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.688934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.689075] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 already deleted. [ 739.690038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.799820] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 in Status: SUCCESS [ 739.799990] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d8d678-ef4e-4987-a57b-b8f1a69f0a59 deletion is rescheduled due to dependency. [ 739.800150] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d8d678-ef4e-4987-a57b-b8f1a69f0a59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.027543] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.027742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.027837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.028165] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.028379] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.028493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.028573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.028792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.028901] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.028999] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.029196] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.029302] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.029363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.029563] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.029781] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.029909] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.029984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.030196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.030293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.030396] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.030509] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.086043] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.087048] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.087048] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.087274] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.087723] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.087723] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 33799b3d-5ade-4cb0-ae83-3d00bfd972ca not found, creating... [ 740.087921] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.088125] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.088193] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.088431] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.088569] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.088923] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.089123] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.089237] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.089445] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.089574] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.089712] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 33799b3d-5ade-4cb0-ae83-3d00bfd972ca is going to be created. [ 740.112139] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.112355] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.112470] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.112937] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.113199] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.113434] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-33799b3d-5ade-4cb0-ae83-3d00bfd972ca" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.487068] env[65102]: INFO networking_nsxv3.common.synchronization [req-e2406e37-4ab6-46db-9261-f22973f29dc3 req-41471071-84a8-4184-9acb-d31b25237351 tempest-ServersAdminTestJSON-1629823880 tempest-ServersAdminTestJSON-1629823880-project-member] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 740.487709] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 740.488042] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.488175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.488244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.489119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.489119] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.489119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.489119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.489119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.489119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.489412] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.533160] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e4d0983-93de-4906-b7b5-69591bafe0fd: rpc.has_security_group_logging(os_id): False [ 740.552076] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.552076] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.552076] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.552323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.552323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.552868] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.552868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.552868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.552868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.553249] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.553356] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.553515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.553642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.553849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.554009] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.554358] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.554442] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.554569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.554744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.554849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.554961] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd is going to be updated. [ 740.643403] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.643403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.643403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.643403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.643621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.660127] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: IN_PROGRESS for 2s [ 740.661312] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: SUCCESS [ 740.661531] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.661736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.661958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.662186] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.662330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.662412] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.662644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.662812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.662977] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.774734] env[65102]: INFO networking_nsxv3.common.synchronization [req-9f1a0f85-ea08-48ed-a63c-76b35f2d760c req-5fa1d8fb-147f-4b5d-b17d-949c9a6b183f tempest-SecurityGroupRulesTestJSON-1107260444 tempest-SecurityGroupRulesTestJSON-1107260444-project-member] Enqueued Resource ID: 28e010de-7e44-42a6-91b0-be7557c4514a with Priority: HIGHEST for action security_group_rules [ 740.775495] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28e010de-7e44-42a6-91b0-be7557c4514a with Priority: HIGHEST for action security_group_rules [ 740.776276] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28e010de-7e44-42a6-91b0-be7557c4514a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.776276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28e010de-7e44-42a6-91b0-be7557c4514a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.776276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28e010de-7e44-42a6-91b0-be7557c4514a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.776276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28e010de-7e44-42a6-91b0-be7557c4514a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.776559] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28e010de-7e44-42a6-91b0-be7557c4514a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.861056] env[65102]: INFO networking_nsxv3.common.synchronization [req-80cc2627-b323-4d58-8127-a9fb775d9c5f req-bbfe3960-3ef6-4ac7-bfbd-f74d6641aea2 service nova] Enqueued Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGHEST for action security_group_rules [ 740.861318] env[65102]: INFO networking_nsxv3.common.synchronization [req-80cc2627-b323-4d58-8127-a9fb775d9c5f req-bbfe3960-3ef6-4ac7-bfbd-f74d6641aea2 service nova] Enqueued Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGHEST for action security_group_members [ 740.861479] env[65102]: INFO networking_nsxv3.common.synchronization [req-80cc2627-b323-4d58-8127-a9fb775d9c5f req-bbfe3960-3ef6-4ac7-bfbd-f74d6641aea2 service nova] Enqueued Resource ID: 33799b3d-5ade-4cb0-ae83-3d00bfd972ca with Priority: HIGHEST for action port [ 740.862021] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGHEST for action security_group_rules [ 740.863265] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGHEST for action security_group_members [ 740.863566] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33799b3d-5ade-4cb0-ae83-3d00bfd972ca with Priority: HIGHEST for action port [ 740.863813] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c61af5d-d112-491b-97cd-9e037a2e5189 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.863999] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.864120] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.864396] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.864526] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c61af5d-d112-491b-97cd-9e037a2e5189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.866286] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c61af5d-d112-491b-97cd-9e037a2e5189 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.866796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.866796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.866796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.867018] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.867163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.867249] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.867373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.867486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.867622] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c61af5d-d112-491b-97cd-9e037a2e5189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.868657] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-33799b3d-5ade-4cb0-ae83-3d00bfd972ca taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.868788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33799b3d-5ade-4cb0-ae83-3d00bfd972ca" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.868910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33799b3d-5ade-4cb0-ae83-3d00bfd972ca" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.869130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33799b3d-5ade-4cb0-ae83-3d00bfd972ca" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.869223] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33799b3d-5ade-4cb0-ae83-3d00bfd972ca',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.991679] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.165794] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.317448] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.317690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.317769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.318015] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.318122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.319416] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28e010de-7e44-42a6-91b0-be7557c4514a already deleted. [ 741.319416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28e010de-7e44-42a6-91b0-be7557c4514a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.351581] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44148911-e2d1-4130-8398-a96a2ea96086 in Status: SUCCESS [ 741.351811] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44148911-e2d1-4130-8398-a96a2ea96086 deletion is rescheduled due to dependency. [ 741.351977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.371677] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c61af5d-d112-491b-97cd-9e037a2e5189 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.371898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.372040] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c61af5d-d112-491b-97cd-9e037a2e5189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.373027] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33799b3d-5ade-4cb0-ae83-3d00bfd972ca with status ACTIVE [ 741.373355] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.373502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.373566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.373750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.374958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.374958] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.374958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.374958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.374958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.374958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.374958] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.374958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.374958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.374958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.374958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.375400] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33799b3d-5ade-4cb0-ae83-3d00bfd972ca is going to be updated. [ 741.411927] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.412131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.412174] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.412385] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.412602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.412787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33799b3d-5ade-4cb0-ae83-3d00bfd972ca" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.494661] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.669424] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.877531] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c61af5d-d112-491b-97cd-9e037a2e5189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.926449] env[65102]: INFO networking_nsxv3.common.synchronization [req-18520d22-1dba-4263-ad31-f2acde5b01f8 req-7962ad08-c4af-4df4-a75d-f08dca8ceea5 tempest-ServersWithSpecificFlavorTestJSON-1123838888 tempest-ServersWithSpecificFlavorTestJSON-1123838888-project-member] Enqueued Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_members [ 741.927592] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_members [ 741.930075] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.930075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.930075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.930075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.930075] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.930075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.930075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.930075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.930075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.930075] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.002388] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.002388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.002388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.002388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.002388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.002388] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be updated. [ 742.034108] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.034108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.034108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.034108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.034108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.048355] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 742.172278] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.172555] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.172555] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.172753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.172853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.172958] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 is going to be updated. [ 742.204202] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.204784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.204893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.205188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.205502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.217553] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: IN_PROGRESS for 2s [ 742.380137] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.380305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.380377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.380636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.380762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.380884] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 is going to be created. [ 742.409474] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.409782] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.409853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.410125] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.410418] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.428103] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 in Status: UNINITIALIZED for 2s [ 742.432133] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.432330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.432374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.432917] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.465356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.465356] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.465356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.465356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.465716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.465716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.465716] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a is going to be updated. [ 742.518070] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.518070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.518070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.518070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.518070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.530277] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a in Status: IN_PROGRESS for 2s [ 742.675168] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: SUCCESS [ 742.675475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.675688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.675911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.676043] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.178076] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.178235] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.178309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.178948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.179155] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.179278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.179351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.179508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.179597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.179688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.179784] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.608629] env[65102]: INFO networking_nsxv3.common.synchronization [req-d2f97575-99de-4933-898b-475979ccf9f3 req-a4e8f766-ea1a-402d-947a-47b21269f168 tempest-SecurityGroupRulesTestJSON-1107260444 tempest-SecurityGroupRulesTestJSON-1107260444-project-member] Enqueued Resource ID: f5c7f8ba-f0bb-4c86-8d7f-36f5573e6f61 with Priority: HIGHEST for action security_group_rules [ 743.608629] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5c7f8ba-f0bb-4c86-8d7f-36f5573e6f61 with Priority: HIGHEST for action security_group_rules [ 743.609976] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5c7f8ba-f0bb-4c86-8d7f-36f5573e6f61 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.610300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5c7f8ba-f0bb-4c86-8d7f-36f5573e6f61" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.613287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5c7f8ba-f0bb-4c86-8d7f-36f5573e6f61" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.613287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5c7f8ba-f0bb-4c86-8d7f-36f5573e6f61" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.613287] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5c7f8ba-f0bb-4c86-8d7f-36f5573e6f61',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.690072] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.690072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.690072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.690072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.690072] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.690072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.690072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.690072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.690072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.690072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.690072] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.690072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.690072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.690072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.690072] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.690072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.691050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.691050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.691050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.691050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.691050] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.060363] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 744.060583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.132269] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.132470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.132470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.132744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.132835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.132936] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5c7f8ba-f0bb-4c86-8d7f-36f5573e6f61 already deleted. [ 744.133054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5c7f8ba-f0bb-4c86-8d7f-36f5573e6f61" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.202476] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e4d0983-93de-4906-b7b5-69591bafe0fd: rpc.has_security_group_logging(os_id): False [ 744.222292] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.222292] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.222292] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.222523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.222523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.222639] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.222725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.222788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.222933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.223017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.223356] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.223456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.223520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.223686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.223757] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.223949] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.224059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.224122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.224261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.224363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.224443] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd is going to be updated. [ 744.228055] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: IN_PROGRESS for 4s [ 744.302277] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.302277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.302277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.302277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.302465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.337275] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: IN_PROGRESS for 2s [ 744.437896] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 in Status: SUCCESS [ 744.438254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.438481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.438767] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.439071] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.439236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.439320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.439918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.439918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.439918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.439918] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c61af5d-d112-491b-97cd-9e037a2e5189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.545034] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a in Status: SUCCESS [ 744.545034] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a deletion is rescheduled due to dependency. [ 744.545034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.942819] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c61af5d-d112-491b-97cd-9e037a2e5189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.326718] env[65102]: INFO networking_nsxv3.common.synchronization [req-011f6f04-163d-4e96-91c5-d8fde1f57adb req-785376e8-a1fa-4e6b-bc1b-97bb62e0a6bc tempest-AttachInterfacesV270Test-1992497490 tempest-AttachInterfacesV270Test-1992497490-project-member] Enqueued Resource ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 with Priority: HIGHEST for action security_group_members [ 745.327296] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 with Priority: HIGHEST for action security_group_members [ 745.327572] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4563a809-6b5f-4203-a94d-ff2468059ed7 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.327689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.327768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.327947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.328150] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.328627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.328735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.328915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.329039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.329110] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4563a809-6b5f-4203-a94d-ff2468059ed7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.448041] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c61af5d-d112-491b-97cd-9e037a2e5189: rpc.has_security_group_logging(os_id): False [ 745.473498] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.473664] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.473753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.474012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.474121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.474425] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.474570] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.474647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.474854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.474907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.474981] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 is going to be created. [ 745.550503] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.550682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.550809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.551161] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.551433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.564381] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 in Status: IN_PROGRESS for 2s [ 745.631902] env[65102]: INFO networking_nsxv3.common.synchronization [req-13c5618c-ab18-4c0c-9148-127696db953d req-93dc52e1-322f-447e-abc2-6d3ab66f7446 tempest-SecurityGroupRulesTestJSON-1107260444 tempest-SecurityGroupRulesTestJSON-1107260444-project-member] Enqueued Resource ID: 0ce658e6-d6ca-46d5-850e-761a8603b613 with Priority: HIGHEST for action security_group_rules [ 745.634851] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce658e6-d6ca-46d5-850e-761a8603b613 with Priority: HIGHEST for action security_group_rules [ 745.634851] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ce658e6-d6ca-46d5-850e-761a8603b613 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.634851] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ce658e6-d6ca-46d5-850e-761a8603b613" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.634851] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ce658e6-d6ca-46d5-850e-761a8603b613" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.634851] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ce658e6-d6ca-46d5-850e-761a8603b613" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.634851] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ce658e6-d6ca-46d5-850e-761a8603b613',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.832867] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.832968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.833057] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.833380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.833514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.833747] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.833886] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.833954] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.834190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.834303] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.834399] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 is going to be updated. [ 745.868931] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.868931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.868931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.868931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.868931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.879344] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 in Status: IN_PROGRESS for 2s [ 746.156632] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.156632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.156632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.157077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.157077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.157077] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ce658e6-d6ca-46d5-850e-761a8603b613 already deleted. [ 746.157077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ce658e6-d6ca-46d5-850e-761a8603b613" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.241171] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: SUCCESS [ 746.241396] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.241573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.241788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.241982] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.242136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.242210] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.242405] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.242498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.242585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.242677] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.321059] env[65102]: INFO networking_nsxv3.common.synchronization [req-bcce7abd-ebc6-4c3e-9258-9e8e7de0eee0 req-9b2ccd3c-1e80-4fcf-98c9-efb7f3f9eab5 tempest-DeleteServersTestJSON-1773899535 tempest-DeleteServersTestJSON-1773899535-project-member] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 746.321059] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 746.321059] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.321059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.322272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.322550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.322838] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.322838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.322949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.323238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.323238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.323238] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.356734] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: SUCCESS [ 746.357449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.411035] env[65102]: INFO networking_nsxv3.common.synchronization [req-d8ec0b59-209d-4c33-8445-ba74ecedb5ec req-7f3250e0-944d-4a0e-8144-3a6f83a3013f tempest-SecurityGroupRulesTestJSON-1107260444 tempest-SecurityGroupRulesTestJSON-1107260444-project-member] Enqueued Resource ID: 0ce658e6-d6ca-46d5-850e-761a8603b613 with Priority: HIGHEST for action security_group_rules [ 746.411035] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce658e6-d6ca-46d5-850e-761a8603b613 with Priority: HIGHEST for action security_group_rules [ 746.414476] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ce658e6-d6ca-46d5-850e-761a8603b613 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.414476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ce658e6-d6ca-46d5-850e-761a8603b613" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.414660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ce658e6-d6ca-46d5-850e-761a8603b613" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.414779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ce658e6-d6ca-46d5-850e-761a8603b613" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.414916] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ce658e6-d6ca-46d5-850e-761a8603b613',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.745553] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.745968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.745968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.746122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.746166] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.746266] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.746346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.746510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.746603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.746689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.746841] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.746924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.746990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.747175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.747323] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.747407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.747463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.747602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.747696] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.747783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.747872] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.825153] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.825238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.825238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.825519] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.846191] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.846496] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.846598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.846666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.846859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.846948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.847071] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 746.874689] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.875067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.875067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.875184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.875309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.884462] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 746.936991] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.936991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.936991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.936991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.936991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.936991] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ce658e6-d6ca-46d5-850e-761a8603b613 already deleted. [ 746.936991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ce658e6-d6ca-46d5-850e-761a8603b613" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.255070] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5a72f78-b26f-4670-a8f0-eea902ebea26: rpc.has_security_group_logging(os_id): False [ 747.277897] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.278308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.278449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.278738] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.302069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.302666] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.302819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.302972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.303471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.303652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.304151] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.304488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.304587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.304794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.304917] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.305148] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.305251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.305330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.305573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.305627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.305690] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 is going to be updated. [ 747.404918] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.405139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.405181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.405432] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.405571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.411118] env[65102]: INFO networking_nsxv3.common.synchronization [req-d6bdd7bc-a544-4475-9ef7-fe30b12f4802 req-59a65434-f3bb-4f54-a8bd-85f5a488b30e tempest-SecurityGroupRulesTestJSON-1107260444 tempest-SecurityGroupRulesTestJSON-1107260444-project-member] Enqueued Resource ID: 0ce658e6-d6ca-46d5-850e-761a8603b613 with Priority: HIGHEST for action security_group_rules [ 747.411921] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce658e6-d6ca-46d5-850e-761a8603b613 with Priority: HIGHEST for action security_group_rules [ 747.411921] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ce658e6-d6ca-46d5-850e-761a8603b613 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.412178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ce658e6-d6ca-46d5-850e-761a8603b613" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.412178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ce658e6-d6ca-46d5-850e-761a8603b613" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.413388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ce658e6-d6ca-46d5-850e-761a8603b613" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.413388] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ce658e6-d6ca-46d5-850e-761a8603b613',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.427560] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: IN_PROGRESS for 2s [ 747.576621] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 in Status: SUCCESS [ 747.576885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.891526] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 in Status: SUCCESS [ 747.891707] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 deletion is rescheduled due to dependency. [ 747.891818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.935647] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.939088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.939088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.939088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.939088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.939088] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ce658e6-d6ca-46d5-850e-761a8603b613 already deleted. [ 747.939088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ce658e6-d6ca-46d5-850e-761a8603b613" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.658995] env[65102]: INFO networking_nsxv3.common.synchronization [req-6b357707-17ff-481b-ab77-6d39da2a0efc req-dc493ad5-ccbc-4a38-b9e2-d3ca5a3a42a9 tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: 85b46990-bd7b-4abe-881c-9016519cf955 with Priority: HIGHEST for action security_group_members [ 748.658995] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85b46990-bd7b-4abe-881c-9016519cf955 with Priority: HIGHEST for action security_group_members [ 748.659314] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-85b46990-bd7b-4abe-881c-9016519cf955 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.659314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.659430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.659607] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.659763] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.659923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.659964] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.660130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.660215] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.660308] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85b46990-bd7b-4abe-881c-9016519cf955',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.897703] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 748.897703] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f deletion is rescheduled due to dependency. [ 748.897703] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.958984] env[65102]: INFO networking_nsxv3.common.synchronization [None req-cfafd1c6-acea-4bde-942c-24a9cae7cf6a None None] Enqueued Resource ID: f4e4b023-d2b2-4775-b14d-ce22c9fac97b with Priority: HIGHEST for action port [ 748.960282] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4e4b023-d2b2-4775-b14d-ce22c9fac97b with Priority: HIGHEST for action port [ 748.960610] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4e4b023-d2b2-4775-b14d-ce22c9fac97b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.961724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4e4b023-d2b2-4775-b14d-ce22c9fac97b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.961724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4e4b023-d2b2-4775-b14d-ce22c9fac97b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.961866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4e4b023-d2b2-4775-b14d-ce22c9fac97b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.964494] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4e4b023-d2b2-4775-b14d-ce22c9fac97b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.163848] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.164051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.164128] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.164361] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.164481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.164699] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.164942] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.164942] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.165051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.165173] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.165230] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85b46990-bd7b-4abe-881c-9016519cf955 already deleted. [ 749.165311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.185890] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.186143] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.186263] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.186660] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.187461] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.187629] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.187775] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.188024] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.188173] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.188460] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.188583] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 749.188691] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 749.188796] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 749.188902] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 749.189009] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 749.189145] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 749.212519] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 749.212687] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 749.212809] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 749.213155] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.214082] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-b44410c9-c28d-4e13-879d-3e495fde9ff4 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.214082] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-b44410c9-c28d-4e13-879d-3e495fde9ff4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.214082] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-b44410c9-c28d-4e13-879d-3e495fde9ff4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.214538] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-b44410c9-c28d-4e13-879d-3e495fde9ff4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.214681] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b44410c9-c28d-4e13-879d-3e495fde9ff4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.443256] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: SUCCESS [ 749.443256] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.464566] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4e4b023-d2b2-4775-b14d-ce22c9fac97b [ 749.464828] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.464953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.465358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.465358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.465358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.465582] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4e4b023-d2b2-4775-b14d-ce22c9fac97b already deleted. [ 749.465582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4e4b023-d2b2-4775-b14d-ce22c9fac97b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.498845] env[65102]: INFO networking_nsxv3.common.synchronization [req-cfe6d078-eaaf-480c-a820-3542af5cfa69 req-0a197fd3-fd32-45c0-bdc7-99f83d89109e tempest-ListImageFiltersTestJSON-812883063 tempest-ListImageFiltersTestJSON-812883063-project-member] Enqueued Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_members [ 749.499772] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_members [ 749.501065] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.501065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.501065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.501065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.501065] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.501065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.501065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.501815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.501815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.501815] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.716626] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.717043] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.717043] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.717365] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.717555] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.717740] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port b44410c9-c28d-4e13-879d-3e495fde9ff4 not found, creating... [ 749.718239] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.718460] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.718587] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.718842] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.718986] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.719292] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.719447] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.719572] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.719800] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.719935] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.720089] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: b44410c9-c28d-4e13-879d-3e495fde9ff4 is going to be created. [ 749.740322] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.740539] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.740642] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.740915] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.741153] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.741379] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-b44410c9-c28d-4e13-879d-3e495fde9ff4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.004928] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.468162] env[65102]: INFO networking_nsxv3.common.synchronization [req-6b357707-17ff-481b-ab77-6d39da2a0efc req-550ee85e-0105-4f8d-8e6e-3fe90def2fa5 service nova] Enqueued Resource ID: 85b46990-bd7b-4abe-881c-9016519cf955 with Priority: HIGHEST for action security_group_rules [ 750.468162] env[65102]: INFO networking_nsxv3.common.synchronization [req-6b357707-17ff-481b-ab77-6d39da2a0efc req-550ee85e-0105-4f8d-8e6e-3fe90def2fa5 service nova] Enqueued Resource ID: 85b46990-bd7b-4abe-881c-9016519cf955 with Priority: HIGHEST for action security_group_members [ 750.468162] env[65102]: INFO networking_nsxv3.common.synchronization [req-6b357707-17ff-481b-ab77-6d39da2a0efc req-550ee85e-0105-4f8d-8e6e-3fe90def2fa5 service nova] Enqueued Resource ID: b44410c9-c28d-4e13-879d-3e495fde9ff4 with Priority: HIGHEST for action port [ 750.468330] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85b46990-bd7b-4abe-881c-9016519cf955 with Priority: HIGHEST for action security_group_rules [ 750.468368] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85b46990-bd7b-4abe-881c-9016519cf955 with Priority: HIGHEST for action security_group_members [ 750.468454] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b44410c9-c28d-4e13-879d-3e495fde9ff4 with Priority: HIGHEST for action port [ 750.468719] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85b46990-bd7b-4abe-881c-9016519cf955 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.468840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.468904] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.469272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.469359] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85b46990-bd7b-4abe-881c-9016519cf955',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.471424] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-85b46990-bd7b-4abe-881c-9016519cf955 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.471559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.472260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.472260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.472260] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.472260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.472516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.472516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.472577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.472633] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85b46990-bd7b-4abe-881c-9016519cf955',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.473533] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b44410c9-c28d-4e13-879d-3e495fde9ff4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.473653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b44410c9-c28d-4e13-879d-3e495fde9ff4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.473702] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b44410c9-c28d-4e13-879d-3e495fde9ff4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.473836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b44410c9-c28d-4e13-879d-3e495fde9ff4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.473908] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b44410c9-c28d-4e13-879d-3e495fde9ff4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.507864] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.976366] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85b46990-bd7b-4abe-881c-9016519cf955',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.977308] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-85b46990-bd7b-4abe-881c-9016519cf955 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.977431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.978698] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b44410c9-c28d-4e13-879d-3e495fde9ff4 with status ACTIVE [ 750.978907] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.979466] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.979466] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.979466] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.979466] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.979682] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.979682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.979798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.980122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.980122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.980122] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.980278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.980278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.980433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.980473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.980548] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b44410c9-c28d-4e13-879d-3e495fde9ff4 is going to be updated. [ 751.009859] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.010792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.010792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.010792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.010792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.010792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b44410c9-c28d-4e13-879d-3e495fde9ff4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.012180] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.013052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.013052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.013052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.013661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.013661] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 is going to be updated. [ 751.045405] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.045643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.045643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.045956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.047698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.057141] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 in Status: IN_PROGRESS for 2s [ 751.134774] env[65102]: INFO networking_nsxv3.common.synchronization [None req-524372f9-d674-4544-8d04-73c1022e909f tempest-ServerActionsTestJSON-273915797 tempest-ServerActionsTestJSON-273915797-project-member] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_rules [ 751.135546] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_rules [ 751.135660] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.135795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.135864] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.136845] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.136938] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.344192] env[65102]: INFO networking_nsxv3.common.synchronization [None req-167193cf-8e89-4887-bb3d-dacb054faa3f tempest-ServerActionsTestJSON-273915797 tempest-ServerActionsTestJSON-273915797-project-member] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_rules [ 751.344720] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_rules [ 751.345033] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.345141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.483471] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85b46990-bd7b-4abe-881c-9016519cf955',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.614639] env[65102]: INFO networking_nsxv3.common.synchronization [req-002003e7-ad1e-49d0-97df-908ef0762553 req-da08959d-140b-41ac-ad95-75ddf2410972 tempest-ServersV294TestFqdnHostnames-1427429126 tempest-ServersV294TestFqdnHostnames-1427429126-project-member] Enqueued Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGHEST for action security_group_members [ 751.615260] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGHEST for action security_group_members [ 751.615810] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29f22186-8565-4d84-ad72-633756f6f315 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.615952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.616034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.616308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.616676] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.616862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.616943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.617169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.617299] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.617429] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29f22186-8565-4d84-ad72-633756f6f315',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.658856] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.659035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.659126] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.659394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.659500] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.659713] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b already deleted. [ 751.659713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.660053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.660178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.660268] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.706901] env[65102]: INFO networking_nsxv3.common.synchronization [None req-4c3cace3-3fd8-445c-b51e-7f2db39dfbcf None None] Enqueued Resource ID: 8ad3c5fd-40bb-4a1e-83f6-7245e2177514 with Priority: HIGHEST for action port [ 751.707395] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ad3c5fd-40bb-4a1e-83f6-7245e2177514 with Priority: HIGHEST for action port [ 751.707698] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ad3c5fd-40bb-4a1e-83f6-7245e2177514 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.707826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ad3c5fd-40bb-4a1e-83f6-7245e2177514" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.707895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ad3c5fd-40bb-4a1e-83f6-7245e2177514" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.710802] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ad3c5fd-40bb-4a1e-83f6-7245e2177514" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.710802] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ad3c5fd-40bb-4a1e-83f6-7245e2177514',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.987552] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.987819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.987819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.987945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.988040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.989066] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85b46990-bd7b-4abe-881c-9016519cf955 is going to be created. [ 752.016281] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.016466] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.016507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.016779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.016952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.028185] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85b46990-bd7b-4abe-881c-9016519cf955 in Status: UNINITIALIZED for 2s [ 752.119812] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.119974] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.120066] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.120321] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.120420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.120632] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.120733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.120793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.120943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.121053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.121143] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29f22186-8565-4d84-ad72-633756f6f315 already deleted. [ 752.121234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.165707] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.165961] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-61" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.166102] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-61" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.166419] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-61" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.166716] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.166903] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.167036] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.167259] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.167399] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.167700] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.167852] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.167972] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.168095] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.168205] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.168307] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.168454] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.186365] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.186555] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.186597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.186803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.186901] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.186999] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b already deleted. [ 752.187109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.188069] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.188268] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 752.188407] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.188569] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-61" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.188847] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-0d76af9c-1e77-4b0e-908b-551c74fe95ee taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.189014] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-0d76af9c-1e77-4b0e-908b-551c74fe95ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.189132] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-0d76af9c-1e77-4b0e-908b-551c74fe95ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.189405] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-0d76af9c-1e77-4b0e-908b-551c74fe95ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.189537] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d76af9c-1e77-4b0e-908b-551c74fe95ee',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.212281] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ad3c5fd-40bb-4a1e-83f6-7245e2177514 [ 752.212503] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.212633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.212704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.212896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.212985] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.213091] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ad3c5fd-40bb-4a1e-83f6-7245e2177514 already deleted. [ 752.213176] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ad3c5fd-40bb-4a1e-83f6-7245e2177514" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.691792] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.691996] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.692169] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.692470] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.692614] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.693316] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 0d76af9c-1e77-4b0e-908b-551c74fe95ee not found, creating... [ 752.693316] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.693316] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.693543] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.693618] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.693752] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.694068] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.694228] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.694336] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.694557] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.694690] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.694823] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 0d76af9c-1e77-4b0e-908b-551c74fe95ee is going to be created. [ 752.715721] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.715961] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.716077] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.716354] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.716638] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.716864] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-0d76af9c-1e77-4b0e-908b-551c74fe95ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.067909] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 in Status: SUCCESS [ 753.068291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.190265] env[65102]: INFO networking_nsxv3.common.synchronization [None req-e79f26ef-8e98-494e-92bd-33aa14e82fcb None None] Enqueued Resource ID: 7abd5462-dbb8-400a-bcfe-a6a4cc6eb678 with Priority: HIGHEST for action port [ 753.191329] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7abd5462-dbb8-400a-bcfe-a6a4cc6eb678 with Priority: HIGHEST for action port [ 753.191329] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-7abd5462-dbb8-400a-bcfe-a6a4cc6eb678 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.191329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7abd5462-dbb8-400a-bcfe-a6a4cc6eb678" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.191329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7abd5462-dbb8-400a-bcfe-a6a4cc6eb678" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.191484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7abd5462-dbb8-400a-bcfe-a6a4cc6eb678" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.191484] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7abd5462-dbb8-400a-bcfe-a6a4cc6eb678',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.408244] env[65102]: INFO networking_nsxv3.common.synchronization [req-002003e7-ad1e-49d0-97df-908ef0762553 req-bf129f4a-be4d-4daa-bf8e-3c44c2b8b6ed service nova] Enqueued Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGHEST for action security_group_rules [ 753.408727] env[65102]: INFO networking_nsxv3.common.synchronization [req-002003e7-ad1e-49d0-97df-908ef0762553 req-bf129f4a-be4d-4daa-bf8e-3c44c2b8b6ed service nova] Enqueued Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGHEST for action security_group_members [ 753.408880] env[65102]: INFO networking_nsxv3.common.synchronization [req-002003e7-ad1e-49d0-97df-908ef0762553 req-bf129f4a-be4d-4daa-bf8e-3c44c2b8b6ed service nova] Enqueued Resource ID: 0d76af9c-1e77-4b0e-908b-551c74fe95ee with Priority: HIGHEST for action port [ 753.409824] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGHEST for action security_group_rules [ 753.409985] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGHEST for action security_group_members [ 753.410126] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d76af9c-1e77-4b0e-908b-551c74fe95ee with Priority: HIGHEST for action port [ 753.410435] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29f22186-8565-4d84-ad72-633756f6f315 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.410638] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.410738] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.410983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.411113] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29f22186-8565-4d84-ad72-633756f6f315',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.412187] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29f22186-8565-4d84-ad72-633756f6f315 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.412352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.412444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.412621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.412817] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.412938] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.413025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.413198] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.413315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.413432] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29f22186-8565-4d84-ad72-633756f6f315',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.414450] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d76af9c-1e77-4b0e-908b-551c74fe95ee taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.414593] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d76af9c-1e77-4b0e-908b-551c74fe95ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.414687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d76af9c-1e77-4b0e-908b-551c74fe95ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.414863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d76af9c-1e77-4b0e-908b-551c74fe95ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.414975] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d76af9c-1e77-4b0e-908b-551c74fe95ee',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.693022] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7abd5462-dbb8-400a-bcfe-a6a4cc6eb678 [ 753.693262] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.693394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.693463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.693732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.693827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.693923] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7abd5462-dbb8-400a-bcfe-a6a4cc6eb678 already deleted. [ 753.694013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7abd5462-dbb8-400a-bcfe-a6a4cc6eb678" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.916982] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29f22186-8565-4d84-ad72-633756f6f315',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.918289] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29f22186-8565-4d84-ad72-633756f6f315 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.918462] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.918874] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d76af9c-1e77-4b0e-908b-551c74fe95ee with status ACTIVE [ 753.918874] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.918961] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.919044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.920032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.920032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.920032] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.920032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.920032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.920032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.920032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.920379] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.920379] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.920379] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.920620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.920620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.920684] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d76af9c-1e77-4b0e-908b-551c74fe95ee is going to be updated. [ 753.950453] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.950637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.950675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.950863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.951031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.951203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d76af9c-1e77-4b0e-908b-551c74fe95ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.998022] env[65102]: INFO networking_nsxv3.common.synchronization [req-061aff56-a2c3-489a-b2be-f1dc54dea521 req-47545607-aac2-4e9f-b286-508f1151d6e1 tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 with Priority: HIGHEST for action security_group_members [ 753.998022] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 with Priority: HIGHEST for action security_group_members [ 753.998022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce19aa8e-b26d-4484-8765-4894bdbb95a0 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.998022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.998022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.998022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.998022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.998022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.998022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.998022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.998022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.998022] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce19aa8e-b26d-4484-8765-4894bdbb95a0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.052828] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85b46990-bd7b-4abe-881c-9016519cf955 in Status: SUCCESS [ 754.053090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.053251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.053485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.053708] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.053835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.053894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.054102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.054205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.054292] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.054473] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85b46990-bd7b-4abe-881c-9016519cf955',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.404216] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.404521] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.404521] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.404847] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.405702] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.405897] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.406044] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.406276] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.406439] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.406782] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.406918] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.407039] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.407148] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.407657] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 754.407657] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.407752] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 754.423442] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29f22186-8565-4d84-ad72-633756f6f315',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.429421] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 754.429583] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 754.429716] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 754.429912] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.430451] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-8622bbd6-6068-43cb-9da2-e996d2202ef2 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.430451] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-8622bbd6-6068-43cb-9da2-e996d2202ef2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.430604] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-8622bbd6-6068-43cb-9da2-e996d2202ef2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.430854] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-8622bbd6-6068-43cb-9da2-e996d2202ef2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.431123] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8622bbd6-6068-43cb-9da2-e996d2202ef2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.499633] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.499763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.499900] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.500128] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.500197] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.500414] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.500535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.500601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.500789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.500901] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.501040] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 already deleted. [ 754.501141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.558620] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85b46990-bd7b-4abe-881c-9016519cf955',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.927631] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.927631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.927731] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.927970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.928091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.928503] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29f22186-8565-4d84-ad72-633756f6f315 is going to be created. [ 754.936066] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.936445] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.936556] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.937451] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.937756] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.938517] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 8622bbd6-6068-43cb-9da2-e996d2202ef2 not found, creating... [ 754.938962] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.939381] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.939570] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.939867] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.940238] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.940860] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.941223] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.941363] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.941691] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.941846] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.942028] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 8622bbd6-6068-43cb-9da2-e996d2202ef2 is going to be created. [ 754.961295] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.964142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.964142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.964142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.964142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.972706] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.972706] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.972706] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.972706] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.972706] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.972987] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-8622bbd6-6068-43cb-9da2-e996d2202ef2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.974594] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29f22186-8565-4d84-ad72-633756f6f315 in Status: UNINITIALIZED for 2s [ 755.063030] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85b46990-bd7b-4abe-881c-9016519cf955: rpc.has_security_group_logging(os_id): False [ 755.086568] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.086818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.086937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.087267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.087421] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.087785] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.088469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.088469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.088469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.088469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.088724] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85b46990-bd7b-4abe-881c-9016519cf955 is going to be created. [ 755.168773] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.168945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.169045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.169291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.169479] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.179419] env[65102]: INFO networking_nsxv3.common.synchronization [None req-64565981-bf5b-4599-b264-5766e37e0260 None None] Enqueued Resource ID: 40854bd8-dbe5-4490-88be-4deb58c3e21e with Priority: HIGHEST for action port [ 755.180065] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40854bd8-dbe5-4490-88be-4deb58c3e21e with Priority: HIGHEST for action port [ 755.180339] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-40854bd8-dbe5-4490-88be-4deb58c3e21e taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.180461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40854bd8-dbe5-4490-88be-4deb58c3e21e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.180530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40854bd8-dbe5-4490-88be-4deb58c3e21e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.181757] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40854bd8-dbe5-4490-88be-4deb58c3e21e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.181757] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40854bd8-dbe5-4490-88be-4deb58c3e21e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.183661] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85b46990-bd7b-4abe-881c-9016519cf955 in Status: IN_PROGRESS for 2s [ 755.685452] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40854bd8-dbe5-4490-88be-4deb58c3e21e [ 755.685778] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.685778] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.685883] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.686032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.686955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.686955] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40854bd8-dbe5-4490-88be-4deb58c3e21e already deleted. [ 755.686955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40854bd8-dbe5-4490-88be-4deb58c3e21e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.763520] env[65102]: INFO networking_nsxv3.common.synchronization [req-061aff56-a2c3-489a-b2be-f1dc54dea521 req-7bc3b378-59c2-4100-8dfa-c06ddcb9afb9 service nova] Enqueued Resource ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 with Priority: HIGHEST for action security_group_rules [ 755.763700] env[65102]: INFO networking_nsxv3.common.synchronization [req-061aff56-a2c3-489a-b2be-f1dc54dea521 req-7bc3b378-59c2-4100-8dfa-c06ddcb9afb9 service nova] Enqueued Resource ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 with Priority: HIGHEST for action security_group_members [ 755.763835] env[65102]: INFO networking_nsxv3.common.synchronization [req-061aff56-a2c3-489a-b2be-f1dc54dea521 req-7bc3b378-59c2-4100-8dfa-c06ddcb9afb9 service nova] Enqueued Resource ID: 8622bbd6-6068-43cb-9da2-e996d2202ef2 with Priority: HIGHEST for action port [ 755.764414] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 with Priority: HIGHEST for action security_group_rules [ 755.764552] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 with Priority: HIGHEST for action security_group_members [ 755.764651] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8622bbd6-6068-43cb-9da2-e996d2202ef2 with Priority: HIGHEST for action port [ 755.764925] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.765058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.765133] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.767788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.767788] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce19aa8e-b26d-4484-8765-4894bdbb95a0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.768581] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce19aa8e-b26d-4484-8765-4894bdbb95a0 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.769016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.769016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.769016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.769163] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.770102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.770102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.770102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.770102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.770102] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce19aa8e-b26d-4484-8765-4894bdbb95a0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.770415] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-8622bbd6-6068-43cb-9da2-e996d2202ef2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.770547] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8622bbd6-6068-43cb-9da2-e996d2202ef2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.770871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8622bbd6-6068-43cb-9da2-e996d2202ef2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.770871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8622bbd6-6068-43cb-9da2-e996d2202ef2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.770871] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8622bbd6-6068-43cb-9da2-e996d2202ef2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.273049] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce19aa8e-b26d-4484-8765-4894bdbb95a0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.273999] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce19aa8e-b26d-4484-8765-4894bdbb95a0 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.273999] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.274293] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8622bbd6-6068-43cb-9da2-e996d2202ef2 with status ACTIVE [ 756.274482] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.274482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.274482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.274720] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.275042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.275042] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.275042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.275187] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.275229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.275467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.275530] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.275592] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.275673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.275879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.275917] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.276046] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8622bbd6-6068-43cb-9da2-e996d2202ef2 is going to be updated. [ 756.302205] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.302205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.302378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.302522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.302766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.303321] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8622bbd6-6068-43cb-9da2-e996d2202ef2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.778132] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce19aa8e-b26d-4484-8765-4894bdbb95a0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.987337] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29f22186-8565-4d84-ad72-633756f6f315 in Status: SUCCESS [ 756.987337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.987337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.987337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.987337] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.987337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.987337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.987337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.987337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.987337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.987337] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29f22186-8565-4d84-ad72-633756f6f315',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.197533] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85b46990-bd7b-4abe-881c-9016519cf955 in Status: SUCCESS [ 757.197533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.284718] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.284718] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.284966] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.286807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.286807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.286807] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 is going to be created. [ 757.332047] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.332228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.332275] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.332501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.333092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.345454] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 in Status: UNINITIALIZED for 2s [ 757.490481] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29f22186-8565-4d84-ad72-633756f6f315',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.607984] env[65102]: INFO networking_nsxv3.common.synchronization [req-ebbc4e7c-74b8-47df-bb87-0f5dcfe90c91 req-8135bf66-73eb-4c2e-bfa2-79eb68415f81 tempest-ServersTestMultiNic-160748370 tempest-ServersTestMultiNic-160748370-project-member] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 757.608610] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 757.610019] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.610019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.610019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.610019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.610019] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.610019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.610019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.610019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.610019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.610019] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.992536] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29f22186-8565-4d84-ad72-633756f6f315: rpc.has_security_group_logging(os_id): False [ 758.016340] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.016340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.016340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.016340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.016340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.016706] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.016706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.016706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.016858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.016858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.016913] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29f22186-8565-4d84-ad72-633756f6f315 is going to be created. [ 758.058865] env[65102]: INFO networking_nsxv3.common.synchronization [req-ebbc4e7c-74b8-47df-bb87-0f5dcfe90c91 req-c0554389-9843-4498-9be8-cbf21bcd325b tempest-ServersTestMultiNic-160748370 tempest-ServersTestMultiNic-160748370-project-member] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 758.059569] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 758.059888] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.059992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.112746] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.112746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.112746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.113079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.113079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.114216] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.114346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.114432] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.114615] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.114696] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.114808] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 already deleted. [ 758.114890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.115068] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.115743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.115743] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.115743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.115743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.115743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.116074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.116074] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.159373] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.159553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.159643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.159900] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.160168] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.177222] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29f22186-8565-4d84-ad72-633756f6f315 in Status: IN_PROGRESS for 2s [ 758.464839] env[65102]: INFO networking_nsxv3.common.synchronization [req-ebbc4e7c-74b8-47df-bb87-0f5dcfe90c91 req-103b3d36-01f1-42ef-8215-7f9ba90cf24b tempest-ServersTestMultiNic-160748370 tempest-ServersTestMultiNic-160748370-project-member] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 758.465601] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 758.467352] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.467352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.619135] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.620022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.620213] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.620606] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.622179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.622179] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.622179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.622179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.622179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.622179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.622179] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 already deleted. [ 758.622179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.622690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.622690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.622935] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.623147] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.623260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.623741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.625144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.625262] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.889445] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-429 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.889667] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-429" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.889825] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-429" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.890434] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-429" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.890808] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.891033] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.892029] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.892029] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.892029] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.892029] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.892350] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.892409] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.892613] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.892692] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.892890] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.893252] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.917307] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.917971] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 758.917971] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.917971] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-429" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.918295] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-776f5e6b-b550-48cb-9141-89cfb94a6460 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.918529] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-776f5e6b-b550-48cb-9141-89cfb94a6460" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.918597] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-776f5e6b-b550-48cb-9141-89cfb94a6460" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.918971] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-776f5e6b-b550-48cb-9141-89cfb94a6460" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.919160] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('776f5e6b-b550-48cb-9141-89cfb94a6460',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.131059] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.131559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.131559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.131559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.131712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.131803] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.131956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.131956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.132159] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.132242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.132334] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 already deleted. [ 759.132417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.358153] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 in Status: SUCCESS [ 759.358403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.358538] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.358759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.358964] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.359120] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.359177] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.359318] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.359402] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.359620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.359620] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce19aa8e-b26d-4484-8765-4894bdbb95a0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.421848] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.422158] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.422300] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.422574] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.422733] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.422901] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 776f5e6b-b550-48cb-9141-89cfb94a6460 not found, creating... [ 759.423243] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.423401] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.423513] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.423809] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.423946] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.424307] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.424459] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.424569] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.424771] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.424960] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.425039] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 776f5e6b-b550-48cb-9141-89cfb94a6460 is going to be created. [ 759.451045] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.451294] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.451416] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.451776] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.451923] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.452233] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-776f5e6b-b550-48cb-9141-89cfb94a6460" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.861861] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce19aa8e-b26d-4484-8765-4894bdbb95a0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.194164] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29f22186-8565-4d84-ad72-633756f6f315 in Status: SUCCESS [ 760.194553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.291092] env[65102]: INFO networking_nsxv3.common.synchronization [req-ebbc4e7c-74b8-47df-bb87-0f5dcfe90c91 req-e193e928-00f7-497d-b4ec-37996af71b11 service nova] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_rules [ 760.291331] env[65102]: INFO networking_nsxv3.common.synchronization [req-ebbc4e7c-74b8-47df-bb87-0f5dcfe90c91 req-e193e928-00f7-497d-b4ec-37996af71b11 service nova] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 760.291525] env[65102]: INFO networking_nsxv3.common.synchronization [req-ebbc4e7c-74b8-47df-bb87-0f5dcfe90c91 req-e193e928-00f7-497d-b4ec-37996af71b11 service nova] Enqueued Resource ID: 776f5e6b-b550-48cb-9141-89cfb94a6460 with Priority: HIGHEST for action port [ 760.292306] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_rules [ 760.292496] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 760.292705] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 776f5e6b-b550-48cb-9141-89cfb94a6460 with Priority: HIGHEST for action port [ 760.293058] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.293273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.293379] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.293762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.293884] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.294997] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.295158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.295245] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.295509] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.296446] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.296446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.296446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.296446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.296446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.296446] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.300223] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-776f5e6b-b550-48cb-9141-89cfb94a6460 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.300455] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-776f5e6b-b550-48cb-9141-89cfb94a6460" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.302498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-776f5e6b-b550-48cb-9141-89cfb94a6460" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.303218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-776f5e6b-b550-48cb-9141-89cfb94a6460" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.303218] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('776f5e6b-b550-48cb-9141-89cfb94a6460',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.364236] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce19aa8e-b26d-4484-8765-4894bdbb95a0: rpc.has_security_group_logging(os_id): False [ 760.387583] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.387831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.387831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.388072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.388167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.388411] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.388547] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.388591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.388776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.388835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.388892] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 is going to be created. [ 760.460223] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.460223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.460223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.460415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.460596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.473201] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 in Status: IN_PROGRESS for 2s [ 760.672764] env[65102]: INFO networking_nsxv3.common.synchronization [req-8b77ca92-030d-47f6-b62c-e22daee396ec req-8bc38afb-8802-4227-a41f-c3c8e2c07bf2 tempest-ImagesTestJSON-2026451637 tempest-ImagesTestJSON-2026451637-project-member] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 760.673427] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 760.673892] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.674492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.674492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.674492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.674722] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.674785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.674817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.674962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.675052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.675501] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.808289] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.809554] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.809554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.809701] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 776f5e6b-b550-48cb-9141-89cfb94a6460 with status ACTIVE [ 760.809748] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.809820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.809883] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.810243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.810243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.814282] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.814667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.814667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.814667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.814865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.814903] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.815014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.815090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.815222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.815297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.815381] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 776f5e6b-b550-48cb-9141-89cfb94a6460 is going to be updated. [ 760.835552] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.835703] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.835776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.836108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.836248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.836407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-776f5e6b-b550-48cb-9141-89cfb94a6460" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.167786] env[65102]: INFO networking_nsxv3.common.synchronization [req-e8dab05e-ba5e-4ca1-ad8c-a79516f21a5f req-4d26c63e-0ab1-41eb-9f30-06f526b5d2a1 tempest-ServersTestManualDisk-950056448 tempest-ServersTestManualDisk-950056448-project-member] Enqueued Resource ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d with Priority: HIGHEST for action security_group_members [ 761.168608] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d with Priority: HIGHEST for action security_group_members [ 761.168935] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.170479] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.171636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.171884] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.172103] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.172220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.172296] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.172470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.172638] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.172693] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1e9f6d0-9fe0-49a8-a7c4-58871051f77d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.177547] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.177686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.178744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.178744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.178744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.178744] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.178744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.178744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.179040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.179040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.179210] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad already deleted. [ 761.179309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.227516] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.228100] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.228100] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.228289] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.228585] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.228756] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.228862] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.229199] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.229343] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.229558] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.229665] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.229771] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.229877] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.229984] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.230113] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.230249] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.251066] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.251272] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.251431] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.251665] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.252081] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-a6da0470-a2c9-4d2d-869b-c102c75b6b54 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.252293] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-a6da0470-a2c9-4d2d-869b-c102c75b6b54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.252423] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-a6da0470-a2c9-4d2d-869b-c102c75b6b54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.252777] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-a6da0470-a2c9-4d2d-869b-c102c75b6b54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.252972] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6da0470-a2c9-4d2d-869b-c102c75b6b54',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.317751] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.625029] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-373 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.625240] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-373" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.625363] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-373" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.625685] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-373" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.625982] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.626163] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.626286] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.626490] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.626629] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.626864] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.626963] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.627106] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.627212] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.627322] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.627422] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.627551] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.645750] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.645938] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.646102] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.646275] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-373" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.646581] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-5a370d18-6b6f-48cb-b7ea-50951741486f taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.646746] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-5a370d18-6b6f-48cb-b7ea-50951741486f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.646863] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-5a370d18-6b6f-48cb-b7ea-50951741486f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.647221] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-5a370d18-6b6f-48cb-b7ea-50951741486f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.647356] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a370d18-6b6f-48cb-b7ea-50951741486f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.674976] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.675143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.675211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.675442] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.697288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.697651] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.697829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.697936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.698238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.698501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.698501] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d is going to be updated. [ 761.726896] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.727118] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.727206] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.727438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.727631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.736566] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d in Status: IN_PROGRESS for 2s [ 761.755566] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.755717] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.755781] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.756161] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.756311] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.756465] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port a6da0470-a2c9-4d2d-869b-c102c75b6b54 not found, creating... [ 761.756724] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.756877] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.757032] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.757271] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.757408] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.757686] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.757835] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.757946] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.758169] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.758363] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.758521] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: a6da0470-a2c9-4d2d-869b-c102c75b6b54 is going to be created. [ 761.778236] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.778466] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.778586] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.778853] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.779218] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.779295] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-a6da0470-a2c9-4d2d-869b-c102c75b6b54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.820724] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.820962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.820962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.821159] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.821267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.821370] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be created. [ 761.849539] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.849733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.849733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.849905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.850078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.865513] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: UNINITIALIZED for 2s [ 762.150014] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.150272] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.150417] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.150726] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.150873] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.151043] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 5a370d18-6b6f-48cb-b7ea-50951741486f not found, creating... [ 762.151308] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.151455] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.151629] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.151772] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.151911] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.152224] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.152378] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.152492] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.152692] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.152821] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.152955] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 5a370d18-6b6f-48cb-b7ea-50951741486f is going to be created. [ 762.174051] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.174303] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.174436] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.174747] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.175030] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.175297] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-5a370d18-6b6f-48cb-b7ea-50951741486f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.488154] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 in Status: SUCCESS [ 762.488154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.522739] env[65102]: INFO networking_nsxv3.common.synchronization [req-8b77ca92-030d-47f6-b62c-e22daee396ec req-930c5b8b-8bc3-419b-bed8-142511abd57c service nova] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_rules [ 762.522938] env[65102]: INFO networking_nsxv3.common.synchronization [req-8b77ca92-030d-47f6-b62c-e22daee396ec req-930c5b8b-8bc3-419b-bed8-142511abd57c service nova] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 762.523186] env[65102]: INFO networking_nsxv3.common.synchronization [req-8b77ca92-030d-47f6-b62c-e22daee396ec req-930c5b8b-8bc3-419b-bed8-142511abd57c service nova] Enqueued Resource ID: a6da0470-a2c9-4d2d-869b-c102c75b6b54 with Priority: HIGHEST for action port [ 762.523711] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_rules [ 762.523846] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 762.524592] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6da0470-a2c9-4d2d-869b-c102c75b6b54 with Priority: HIGHEST for action port [ 762.524928] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.525079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.525151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.525406] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.525494] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.526623] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.526623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.526623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.526865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.527024] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.527152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.527219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.528107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.528107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.528107] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.528318] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6da0470-a2c9-4d2d-869b-c102c75b6b54 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.528418] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6da0470-a2c9-4d2d-869b-c102c75b6b54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.528497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6da0470-a2c9-4d2d-869b-c102c75b6b54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.529015] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6da0470-a2c9-4d2d-869b-c102c75b6b54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.529015] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6da0470-a2c9-4d2d-869b-c102c75b6b54',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.914097] env[65102]: INFO networking_nsxv3.common.synchronization [req-ebbc4e7c-74b8-47df-bb87-0f5dcfe90c91 req-a58d5feb-245f-4112-96d3-989841c6b05d service nova] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_rules [ 762.914097] env[65102]: INFO networking_nsxv3.common.synchronization [req-ebbc4e7c-74b8-47df-bb87-0f5dcfe90c91 req-a58d5feb-245f-4112-96d3-989841c6b05d service nova] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 762.914097] env[65102]: INFO networking_nsxv3.common.synchronization [req-ebbc4e7c-74b8-47df-bb87-0f5dcfe90c91 req-a58d5feb-245f-4112-96d3-989841c6b05d service nova] Enqueued Resource ID: 5a370d18-6b6f-48cb-b7ea-50951741486f with Priority: HIGHEST for action port [ 762.914097] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_rules [ 762.914097] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 762.914097] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a370d18-6b6f-48cb-b7ea-50951741486f with Priority: HIGHEST for action port [ 762.914097] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.914097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.914373] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.914373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.914606] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a370d18-6b6f-48cb-b7ea-50951741486f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.914697] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a370d18-6b6f-48cb-b7ea-50951741486f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.914697] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a370d18-6b6f-48cb-b7ea-50951741486f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.914947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a370d18-6b6f-48cb-b7ea-50951741486f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.914994] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a370d18-6b6f-48cb-b7ea-50951741486f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.031618] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.032509] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.032661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.032859] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6da0470-a2c9-4d2d-869b-c102c75b6b54 with status ACTIVE [ 763.033050] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.033205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.033291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.033506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.033589] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.034543] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.034543] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.034543] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.034543] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.034543] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.034543] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.034543] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.034844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.034844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.034844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.035191] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6da0470-a2c9-4d2d-869b-c102c75b6b54 is going to be updated. [ 763.058737] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.058931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.059024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.059289] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.059448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.059612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6da0470-a2c9-4d2d-869b-c102c75b6b54" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.416739] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a370d18-6b6f-48cb-b7ea-50951741486f with status ACTIVE [ 763.416992] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.417157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.417229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.417438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.417530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.417709] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.417806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.417869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.418025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.418109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.418295] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.418680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.418680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.418680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.418680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.418835] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a370d18-6b6f-48cb-b7ea-50951741486f is going to be updated. [ 763.447247] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.447401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.447518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.448075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.448075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.448506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a370d18-6b6f-48cb-b7ea-50951741486f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.537044] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.686999] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-429 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.687233] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-429" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.687350] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-429" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.687616] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-429" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.687868] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.688029] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.688171] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.688386] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.688527] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.688724] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.688833] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.688934] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.689066] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.689176] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.689278] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.689403] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.709980] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.710156] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 763.710285] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.710449] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-429" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.710760] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.710920] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.711045] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.711367] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.711504] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.753912] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d in Status: SUCCESS [ 763.754244] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d deletion is rescheduled due to dependency. [ 763.754340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.875539] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 763.875754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.875920] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.876233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.876434] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.876551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.876632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.876811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.876913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.877035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.877144] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.877975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.878187] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.878376] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.878486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.878553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.878682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.878762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.878847] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.039510] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.039510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.039510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.039709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.039709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.039812] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be created. [ 764.065734] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.065927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.065927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.066262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.066823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.076599] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: UNINITIALIZED for 2s [ 764.213400] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.213702] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.213833] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.214232] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.214430] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.214616] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138 not found, creating... [ 764.214908] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.215120] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.215266] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.215521] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.215688] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.216063] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.216272] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.216417] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.216661] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.216825] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.217054] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138 is going to be created. [ 764.238692] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.238896] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.239031] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.239373] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.239537] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.239750] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.380624] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.380757] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.380991] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.883985] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.976830] env[65102]: INFO networking_nsxv3.common.synchronization [req-ebbc4e7c-74b8-47df-bb87-0f5dcfe90c91 req-3600bc63-412b-44f4-8ab8-f4b03239e8a3 service nova] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_rules [ 764.977227] env[65102]: INFO networking_nsxv3.common.synchronization [req-ebbc4e7c-74b8-47df-bb87-0f5dcfe90c91 req-3600bc63-412b-44f4-8ab8-f4b03239e8a3 service nova] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 764.977507] env[65102]: INFO networking_nsxv3.common.synchronization [req-ebbc4e7c-74b8-47df-bb87-0f5dcfe90c91 req-3600bc63-412b-44f4-8ab8-f4b03239e8a3 service nova] Enqueued Resource ID: 8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138 with Priority: HIGHEST for action port [ 764.978335] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_rules [ 764.978642] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 764.978883] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138 with Priority: HIGHEST for action port [ 764.979441] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.979678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.980185] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.980370] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.980697] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.980820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.980889] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.981130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.981417] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.386727] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.386911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.386996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.387312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.387503] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.387627] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 765.420144] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.422029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.422029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.422029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.422029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.431725] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 765.487558] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138 with status ACTIVE [ 765.487558] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.487558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.487558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.487558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.487558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.487558] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.487558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.487558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.487558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.487558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.487558] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.487558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.487558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.487558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.487558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.487558] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138 is going to be updated. [ 765.512979] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.512979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.512979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.512979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.512979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.512979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f5dd2fd-4cf5-44d2-ad85-4d9916e1b138" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.921856] env[65102]: INFO networking_nsxv3.common.synchronization [req-0e1b7a48-5c0c-4934-929d-fc410c3a715e req-347eff6d-7bf0-4eb5-b09e-48450551f320 tempest-FloatingIPsAssociationTestJSON-1065123087 tempest-FloatingIPsAssociationTestJSON-1065123087-project-member] Enqueued Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_members [ 765.922242] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_members [ 765.922552] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.922676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.922742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.922963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.923101] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.923202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.923264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.923412] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.923499] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.923591] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.090936] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 766.092029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.092029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.092029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.092029] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.092029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.092440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.092440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.092440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.092440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.092546] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.392983] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-985 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.392983] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-985" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.393140] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-985" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.393378] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-985" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.393733] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.393795] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.396183] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.396467] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.396627] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.396887] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.397109] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.397249] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.397357] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.397833] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.397951] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.398175] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.421055] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.421238] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 766.421392] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.421529] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-985" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.421851] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-257c9dd4-8ac7-4bca-abb6-a32d3652c6a2 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.422245] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-257c9dd4-8ac7-4bca-abb6-a32d3652c6a2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.422245] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-257c9dd4-8ac7-4bca-abb6-a32d3652c6a2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.422453] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-257c9dd4-8ac7-4bca-abb6-a32d3652c6a2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.422586] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('257c9dd4-8ac7-4bca-abb6-a32d3652c6a2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.425455] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.595412] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.596082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.596241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.596550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.596740] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.596887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.596962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.597222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.597286] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.597364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.597535] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.597649] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.597711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.597855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.598015] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.598111] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.598179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.598920] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.599089] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.599188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.599283] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.926335] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.926722] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.926722] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.926969] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.927090] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.927249] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 257c9dd4-8ac7-4bca-abb6-a32d3652c6a2 not found, creating... [ 766.927686] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.927686] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.927772] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.927992] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.928106] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.928472] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.928638] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.928743] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.928946] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.929086] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.929226] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 257c9dd4-8ac7-4bca-abb6-a32d3652c6a2 is going to be created. [ 766.930344] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.953377] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.953648] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.953737] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.954166] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.954276] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.954714] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-257c9dd4-8ac7-4bca-abb6-a32d3652c6a2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.101718] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad: rpc.has_security_group_logging(os_id): False [ 767.132765] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.133037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.133166] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.133584] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.133736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.134310] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.134496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.134605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.134894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.135050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.135363] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.135527] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.135641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.135881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.136018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.136387] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.136546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.136655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.136892] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.137032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.137185] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be created. [ 767.219358] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.219358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.219358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.219358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.219358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.236439] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 767.433529] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.433691] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.433763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.433971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.434164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.434277] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b07f4606-a04e-468f-8194-7420bcbd987d is going to be updated. [ 767.444975] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 767.445250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.445430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.445629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.445956] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.445956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.446119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.446220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.446306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.446392] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.446553] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.446634] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.446695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.446838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.446981] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.447144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.447232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.447394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.447473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.447556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.447644] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.448496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.448662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.448808] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.448909] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.448973] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.449152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.449242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.449337] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.482416] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.482581] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.482634] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.482847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.482993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.493354] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: IN_PROGRESS for 2s [ 767.664169] env[65102]: INFO networking_nsxv3.common.synchronization [req-0e1b7a48-5c0c-4934-929d-fc410c3a715e req-8b108f64-264b-4f18-8dbc-c15a42a9c2f6 service nova] Enqueued Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_rules [ 767.664829] env[65102]: INFO networking_nsxv3.common.synchronization [req-0e1b7a48-5c0c-4934-929d-fc410c3a715e req-8b108f64-264b-4f18-8dbc-c15a42a9c2f6 service nova] Enqueued Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_members [ 767.664829] env[65102]: INFO networking_nsxv3.common.synchronization [req-0e1b7a48-5c0c-4934-929d-fc410c3a715e req-8b108f64-264b-4f18-8dbc-c15a42a9c2f6 service nova] Enqueued Resource ID: 257c9dd4-8ac7-4bca-abb6-a32d3652c6a2 with Priority: HIGHEST for action port [ 767.671215] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_rules [ 767.671215] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_members [ 767.671215] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 257c9dd4-8ac7-4bca-abb6-a32d3652c6a2 with Priority: HIGHEST for action port [ 767.671215] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.671215] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.671215] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.671650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.671650] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.672937] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.673423] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.673797] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-257c9dd4-8ac7-4bca-abb6-a32d3652c6a2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.673978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-257c9dd4-8ac7-4bca-abb6-a32d3652c6a2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.674155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-257c9dd4-8ac7-4bca-abb6-a32d3652c6a2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.674374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-257c9dd4-8ac7-4bca-abb6-a32d3652c6a2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.674517] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('257c9dd4-8ac7-4bca-abb6-a32d3652c6a2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.955397] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 220505b1-a182-4b77-b78e-66a35b312ba6: rpc.has_security_group_logging(os_id): False [ 767.955397] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.975516] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.980717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.980717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.980717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.980717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.980717] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.980717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.980717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.980717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.980717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.980717] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.980717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.984754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.984754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.984754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.984754] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.984754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.984754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.984754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.984754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.984754] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be created. [ 768.056326] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.056448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.056871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.056871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.057180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.069027] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 768.182544] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.182544] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.185476] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 257c9dd4-8ac7-4bca-abb6-a32d3652c6a2 with status ACTIVE [ 768.185476] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.185476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.185476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.185476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.185476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.185476] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.185476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.185476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.185476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.185881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.185881] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.185881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.185881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.186023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.186053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.186147] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 257c9dd4-8ac7-4bca-abb6-a32d3652c6a2 is going to be updated. [ 768.213939] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.214084] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.215029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.215029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.215029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.215029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-257c9dd4-8ac7-4bca-abb6-a32d3652c6a2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.462653] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.964112] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.964556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.964556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.964696] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.964839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.965343] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 769.011089] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.012021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.012021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.012021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.012021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.024553] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 769.252204] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 769.252445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.504981] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: SUCCESS [ 769.505245] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.505424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.505650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.505839] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.505956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.506031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.506331] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.506490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.506604] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.008664] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.084000] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 770.085789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.086148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.086491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.086600] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.251537] env[65102]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 770.251815] env[65102]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] NSXv3 Agent Agent loop - iteration:1 started [ 770.514211] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.592838] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.594074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.019448] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.019448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.019448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.019835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.020114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.021441] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b07f4606-a04e-468f-8194-7420bcbd987d is going to be updated. [ 771.041955] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 771.042338] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.042454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.043052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.043052] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.043052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.043052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.043315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.043315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.043382] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.043415] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.092282] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.092282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.092282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.092282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.092282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.101591] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: IN_PROGRESS for 2s [ 771.550944] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.551204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.551362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.551605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.551812] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.551966] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.552058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.552342] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.552396] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.552507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.552743] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.552856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.552925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.553089] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.553238] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.553336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.553399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.553539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.553621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.553704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.553795] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.063073] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 220505b1-a182-4b77-b78e-66a35b312ba6: rpc.has_security_group_logging(os_id): False [ 772.081725] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.081937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.082248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.082854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.082854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.083065] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.083065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.083178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.083296] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.083454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.083564] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.083691] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.083758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.083907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.083985] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.084296] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.084395] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.084544] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.084647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.084748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.084786] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 772.190393] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.191038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.191158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.191403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.191617] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.214565] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 772.671880] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 772.671880] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 773.118453] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: SUCCESS [ 773.118453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.118453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.118453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.119229] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.119229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.119229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.119229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.119229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.119502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.119502] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.580986] env[65102]: INFO networking_nsxv3.common.synchronization [None req-07a704c1-7905-40f1-bb63-ab6dc4c49851 None None] Enqueued Resource ID: edb6be91-55c1-4012-9050-23c82f0cbdca with Priority: HIGHEST for action port [ 773.581948] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edb6be91-55c1-4012-9050-23c82f0cbdca with Priority: HIGHEST for action port [ 773.582173] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-edb6be91-55c1-4012-9050-23c82f0cbdca taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.582571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edb6be91-55c1-4012-9050-23c82f0cbdca" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.582571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edb6be91-55c1-4012-9050-23c82f0cbdca" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.582858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edb6be91-55c1-4012-9050-23c82f0cbdca" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.582991] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edb6be91-55c1-4012-9050-23c82f0cbdca',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.621646] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.621957] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.622063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.622344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.622612] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.622767] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.622869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.623119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.623261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.623406] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.623638] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.623787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.623895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.624149] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.624517] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.624610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.624651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.624852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.624960] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.625098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.625247] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.088440] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port edb6be91-55c1-4012-9050-23c82f0cbdca [ 774.088690] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.088853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.088933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.089208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.089304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.089400] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:edb6be91-55c1-4012-9050-23c82f0cbdca already deleted. [ 774.089510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edb6be91-55c1-4012-9050-23c82f0cbdca" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.128632] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b07f4606-a04e-468f-8194-7420bcbd987d: rpc.has_security_group_logging(os_id): False [ 774.152388] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.152388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.152569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.152655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.175365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.175534] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.175682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.175723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.175918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.176012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.176206] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.176307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.177512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.177512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.177512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.177512] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.177512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.177512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.177512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.177512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.177512] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b07f4606-a04e-468f-8194-7420bcbd987d is going to be updated. [ 774.228086] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 774.228388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.228595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.228916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.229016] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.254869] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.254999] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.255187] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.255356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.255575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.268443] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: IN_PROGRESS for 2s [ 774.592100] env[65102]: INFO networking_nsxv3.common.synchronization [req-e8d00c62-624c-4663-b023-8b3e2446266a req-3ad1e381-3464-4244-9db4-dfe12d6abf52 tempest-ListServersNegativeTestJSON-1289631193 tempest-ListServersNegativeTestJSON-1289631193-project-member] Enqueued Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 774.592662] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 774.592977] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.597308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.597394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.597624] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.597904] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.598012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.598055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.598247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.598357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.598434] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.733627] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.733955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.734348] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.740902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.741089] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.742866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.742866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.742866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.742866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.742866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.742866] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.905958] env[65102]: INFO networking_nsxv3.common.synchronization [req-a203ca08-0481-41af-918a-731eaabf1135 req-4302e407-2243-4a75-a102-2838bbc2114e tempest-ListServersNegativeTestJSON-1289631193 tempest-ListServersNegativeTestJSON-1289631193-project-member] Enqueued Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 774.907035] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGHEST for action security_group_members [ 774.907035] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.907035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.101318] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.245966] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.246351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.246351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.246540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.246700] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.246803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.246867] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.247052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.247129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.247599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.247599] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.247599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.247599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.247763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.247895] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.247966] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.248110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.248209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.248256] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.248419] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.248419] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.610817] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.753100] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 220505b1-a182-4b77-b78e-66a35b312ba6: rpc.has_security_group_logging(os_id): False [ 775.776020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.776020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.776020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.776020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.776020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.776020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.776020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.776020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.776020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.776020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.776020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.776020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.776020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.776020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.776020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.776759] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.777380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.777722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.778280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.779229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.779315] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 775.846373] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.846576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.846666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.846882] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.847046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.862113] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 776.115694] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.115843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.115916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.116158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.116255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.116350] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd is going to be updated. [ 776.146209] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.146209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.146347] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.147026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.147026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.156561] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: IN_PROGRESS for 2s [ 776.292050] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: SUCCESS [ 776.292050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.896254] env[65102]: INFO networking_nsxv3.common.synchronization [None req-6aec13fc-0c24-466a-97ca-bab63057f1a5 None None] Enqueued Resource ID: 774617bd-92ab-4dab-96ca-6b9e048c319c with Priority: HIGHEST for action port [ 776.896254] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 774617bd-92ab-4dab-96ca-6b9e048c319c with Priority: HIGHEST for action port [ 776.896254] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-774617bd-92ab-4dab-96ca-6b9e048c319c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.896254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-774617bd-92ab-4dab-96ca-6b9e048c319c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.896254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-774617bd-92ab-4dab-96ca-6b9e048c319c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.896254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-774617bd-92ab-4dab-96ca-6b9e048c319c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.896254] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('774617bd-92ab-4dab-96ca-6b9e048c319c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.398843] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 774617bd-92ab-4dab-96ca-6b9e048c319c [ 777.399146] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.399208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.399313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.399699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.399699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.399699] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:774617bd-92ab-4dab-96ca-6b9e048c319c already deleted. [ 777.399837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-774617bd-92ab-4dab-96ca-6b9e048c319c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.877864] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 777.878111] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.168079] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: SUCCESS [ 778.168301] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.168467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.168685] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.168885] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.169078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.169078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.169232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.169308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.169401] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.477295] env[65102]: INFO networking_nsxv3.common.synchronization [req-16aff422-d46e-46d6-aed2-81e3ec8515b8 req-6c96ea1a-2179-4338-885f-0c759a40e7ea tempest-ServersTestMultiNic-160748370 tempest-ServersTestMultiNic-160748370-project-member] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 778.478389] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 778.480832] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.480832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.480832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.480832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.480832] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.480832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.480832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.480832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.480832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.480832] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.672484] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.672484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.672484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.672484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.672484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.672484] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.672484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.672484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.673169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.673169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.673169] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd is going to be updated. [ 778.712025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.712025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.712025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.712025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.712025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.720464] env[65102]: INFO networking_nsxv3.common.synchronization [req-16aff422-d46e-46d6-aed2-81e3ec8515b8 req-5cd736c1-6223-4803-9845-6080e3f889b6 tempest-ServersTestMultiNic-160748370 tempest-ServersTestMultiNic-160748370-project-member] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 778.720464] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 778.720464] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.720464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.723426] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: IN_PROGRESS for 2s [ 778.924695] env[65102]: INFO networking_nsxv3.common.synchronization [req-16aff422-d46e-46d6-aed2-81e3ec8515b8 req-14450d55-3867-4909-9580-11ce5bfd33ee tempest-ServersTestMultiNic-160748370 tempest-ServersTestMultiNic-160748370-project-member] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 778.924695] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 778.925674] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.925674] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.982576] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.484678] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.987889] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.987889] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.988141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.989029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.989029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.989029] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 780.026554] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.026554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.026554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.026554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.026554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.037915] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 780.732430] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd in Status: SUCCESS [ 780.732716] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd deletion is rescheduled due to dependency. [ 780.732716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.050609] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 782.050609] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.050609] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.051285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.051318] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.051447] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.051485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.052620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.052620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.052620] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.558930] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.559127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.559188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.559419] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.559500] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.559732] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.559894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.559962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.560149] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.560239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.560337] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 782.592346] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.592346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.592346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.592346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.592346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.605395] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 782.716261] env[65102]: INFO networking_nsxv3.common.synchronization [None req-6c7a2a97-8dda-404b-a4a3-15f0d3bcd35e None None] Enqueued Resource ID: cbe986f8-b10d-4e6c-a45f-3b15cbe8cf07 with Priority: HIGHEST for action port [ 782.717229] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe986f8-b10d-4e6c-a45f-3b15cbe8cf07 with Priority: HIGHEST for action port [ 782.717616] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbe986f8-b10d-4e6c-a45f-3b15cbe8cf07 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.717745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbe986f8-b10d-4e6c-a45f-3b15cbe8cf07" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.717808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbe986f8-b10d-4e6c-a45f-3b15cbe8cf07" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.718037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbe986f8-b10d-4e6c-a45f-3b15cbe8cf07" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.718124] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbe986f8-b10d-4e6c-a45f-3b15cbe8cf07',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.220624] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbe986f8-b10d-4e6c-a45f-3b15cbe8cf07 [ 783.221095] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.221095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.221221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.221378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.221508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.221668] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbe986f8-b10d-4e6c-a45f-3b15cbe8cf07 already deleted. [ 783.221715] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbe986f8-b10d-4e6c-a45f-3b15cbe8cf07" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.153638] env[65102]: INFO networking_nsxv3.common.synchronization [req-84a86330-025b-40fa-8925-c1cc8bcff211 req-d76a4bfa-ac34-49d5-a7c4-105eb0cdba92 tempest-ServersAdminTestJSON-1629823880 tempest-ServersAdminTestJSON-1629823880-project-member] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 784.154976] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 784.154976] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.154976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.154976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.154976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.155505] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.155636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.155825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.155990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.156070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.156136] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.562930] env[65102]: INFO networking_nsxv3.common.synchronization [req-96092635-cff1-4b0d-b886-ed106e642e59 req-c705072e-1716-4e8a-93fa-02b593d3e024 tempest-ServersWithSpecificFlavorTestJSON-1123838888 tempest-ServersWithSpecificFlavorTestJSON-1123838888-project-member] Enqueued Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_members [ 784.563491] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_members [ 784.563888] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.563978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.564045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.565140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.565634] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.565804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.565948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.566111] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.566232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.566346] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.618024] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 784.618675] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 deletion is rescheduled due to dependency. [ 784.618675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.618807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.619039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.619232] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.619354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.619467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.619713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.619713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.619802] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.663892] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.000801] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-379 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.000801] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-379" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.000963] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-379" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.001420] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-379" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.001484] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.001602] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.002318] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.002318] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.002580] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.002853] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.003053] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.003227] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.003381] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.003788] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.003788] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.003788] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.026057] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.026057] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.026057] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.026057] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-379" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.026372] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-a8953e74-c080-4161-885f-b88b84a8bab2 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.026512] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-a8953e74-c080-4161-885f-b88b84a8bab2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.026613] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-a8953e74-c080-4161-885f-b88b84a8bab2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.026986] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-a8953e74-c080-4161-885f-b88b84a8bab2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.027134] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8953e74-c080-4161-885f-b88b84a8bab2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.071041] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.071041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.071041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.071041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.071315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.071444] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.071577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.071931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.071931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.071931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.072084] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a is going to be updated. [ 785.100048] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.100267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.100267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.100474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.100655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.111475] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a in Status: IN_PROGRESS for 2s [ 785.122796] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.122796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.122796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.122796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.122796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.124163] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.124163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.124163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.124163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.124163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.124163] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 785.152665] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.152821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.152889] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.153118] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.153820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.159827] env[65102]: INFO networking_nsxv3.common.synchronization [None req-09d3875e-6e9d-4258-a394-a22800b266a5 None None] Enqueued Resource ID: 970c4377-0348-4740-b2ef-77db18502bfa with Priority: HIGHEST for action port [ 785.160657] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 970c4377-0348-4740-b2ef-77db18502bfa with Priority: HIGHEST for action port [ 785.161886] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-970c4377-0348-4740-b2ef-77db18502bfa taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.162030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-970c4377-0348-4740-b2ef-77db18502bfa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.162086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-970c4377-0348-4740-b2ef-77db18502bfa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.162518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-970c4377-0348-4740-b2ef-77db18502bfa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.162856] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('970c4377-0348-4740-b2ef-77db18502bfa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.164050] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.166038] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 785.529457] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.529698] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.529821] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.530111] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.530258] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.530408] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port a8953e74-c080-4161-885f-b88b84a8bab2 not found, creating... [ 785.530663] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.530813] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.530927] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.531161] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.531296] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.531573] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.531718] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.531829] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.532360] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.532573] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.532759] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: a8953e74-c080-4161-885f-b88b84a8bab2 is going to be created. [ 785.558612] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.558851] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.559679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.559679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.559679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.559921] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-a8953e74-c080-4161-885f-b88b84a8bab2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.655157] env[65102]: INFO networking_nsxv3.common.synchronization [None req-9e8279e2-493e-4df1-931a-aa39a955f46e None None] Enqueued Resource ID: 44898385-88f3-4171-9b64-c81a8d8c086f with Priority: HIGHEST for action port [ 785.655960] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44898385-88f3-4171-9b64-c81a8d8c086f with Priority: HIGHEST for action port [ 785.656333] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-44898385-88f3-4171-9b64-c81a8d8c086f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.656465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44898385-88f3-4171-9b64-c81a8d8c086f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.656533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44898385-88f3-4171-9b64-c81a8d8c086f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.656880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44898385-88f3-4171-9b64-c81a8d8c086f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.657014] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44898385-88f3-4171-9b64-c81a8d8c086f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.666275] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 970c4377-0348-4740-b2ef-77db18502bfa [ 785.666859] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.666859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.666859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.667067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.667067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.667148] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:970c4377-0348-4740-b2ef-77db18502bfa already deleted. [ 785.667222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-970c4377-0348-4740-b2ef-77db18502bfa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.667558] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.667660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.667725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.667931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.668070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.668111] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be updated. [ 785.710963] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.710963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.710963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.710963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.710963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.728758] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 786.159147] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44898385-88f3-4171-9b64-c81a8d8c086f [ 786.159402] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.159541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.159611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.159831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.159921] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.160030] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44898385-88f3-4171-9b64-c81a8d8c086f already deleted. [ 786.160118] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44898385-88f3-4171-9b64-c81a8d8c086f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.303930] env[65102]: INFO networking_nsxv3.common.synchronization [req-96092635-cff1-4b0d-b886-ed106e642e59 req-63f6c169-5e75-4c09-aba7-1ab4241b1837 service nova] Enqueued Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_rules [ 786.304134] env[65102]: INFO networking_nsxv3.common.synchronization [req-96092635-cff1-4b0d-b886-ed106e642e59 req-63f6c169-5e75-4c09-aba7-1ab4241b1837 service nova] Enqueued Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_members [ 786.304269] env[65102]: INFO networking_nsxv3.common.synchronization [req-96092635-cff1-4b0d-b886-ed106e642e59 req-63f6c169-5e75-4c09-aba7-1ab4241b1837 service nova] Enqueued Resource ID: a8953e74-c080-4161-885f-b88b84a8bab2 with Priority: HIGHEST for action port [ 786.304803] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_rules [ 786.304970] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_members [ 786.307815] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8953e74-c080-4161-885f-b88b84a8bab2 with Priority: HIGHEST for action port [ 786.307815] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.307815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.307815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.307815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.307815] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.308672] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.308837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.314139] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8953e74-c080-4161-885f-b88b84a8bab2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.314366] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8953e74-c080-4161-885f-b88b84a8bab2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.314366] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8953e74-c080-4161-885f-b88b84a8bab2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.314658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8953e74-c080-4161-885f-b88b84a8bab2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.314799] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8953e74-c080-4161-885f-b88b84a8bab2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.771318] env[65102]: INFO networking_nsxv3.common.synchronization [req-963fec51-d8d3-46d5-8219-1d3af0fcb6bf req-954ab8ac-0468-4582-b208-22607e2fc495 tempest-FloatingIPsAssociationTestJSON-1065123087 tempest-FloatingIPsAssociationTestJSON-1065123087-project-member] Enqueued Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_members [ 786.771318] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_members [ 786.772151] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.772151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.772151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.772286] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.772517] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.772517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.772517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.772964] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.772964] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.772964] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.817366] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.817466] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.817805] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8953e74-c080-4161-885f-b88b84a8bab2 with status ACTIVE [ 786.817805] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.817959] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.817959] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.818226] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.818320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.818518] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.818589] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.818687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.818836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.818953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.819119] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.819214] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.819277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.819416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.819492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.819586] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8953e74-c080-4161-885f-b88b84a8bab2 is going to be updated. [ 786.842358] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.842358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.842529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.842629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.842764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.843352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8953e74-c080-4161-885f-b88b84a8bab2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.123332] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a in Status: SUCCESS [ 787.123614] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a deletion is rescheduled due to dependency. [ 787.123699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.123861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.124090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.124279] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.124399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.124911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.124911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.124911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.124911] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.182288] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 787.182437] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 deletion is rescheduled due to dependency. [ 787.182493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.276712] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.350530] env[65102]: INFO networking_nsxv3.common.synchronization [None req-111da641-f53a-4cd9-a625-9c76b9ac1990 None None] Enqueued Resource ID: 77560b3c-b4ce-4feb-8fcb-ec6dc9c88cb1 with Priority: HIGHEST for action port [ 787.351153] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77560b3c-b4ce-4feb-8fcb-ec6dc9c88cb1 with Priority: HIGHEST for action port [ 787.351460] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-77560b3c-b4ce-4feb-8fcb-ec6dc9c88cb1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.351557] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77560b3c-b4ce-4feb-8fcb-ec6dc9c88cb1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.351679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77560b3c-b4ce-4feb-8fcb-ec6dc9c88cb1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.351844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77560b3c-b4ce-4feb-8fcb-ec6dc9c88cb1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.352270] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77560b3c-b4ce-4feb-8fcb-ec6dc9c88cb1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.628727] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.741141] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 787.742032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.779295] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.854246] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77560b3c-b4ce-4feb-8fcb-ec6dc9c88cb1 [ 787.854542] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.854683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.854859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.855018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.855170] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.855272] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77560b3c-b4ce-4feb-8fcb-ec6dc9c88cb1 already deleted. [ 787.855370] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77560b3c-b4ce-4feb-8fcb-ec6dc9c88cb1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.131091] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.282048] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.282233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.282277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.282476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.282560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.282655] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b07f4606-a04e-468f-8194-7420bcbd987d is going to be updated. [ 788.312585] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.312749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.312794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.313643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.313643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.323240] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: IN_PROGRESS for 2s [ 788.634476] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.634710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.634710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.634976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.635071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.635177] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a is going to be updated. [ 788.667812] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.668870] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.668870] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.668870] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.668870] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.679796] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a in Status: IN_PROGRESS for 2s [ 789.044670] env[65102]: INFO networking_nsxv3.common.synchronization [None req-bb19ac01-f3ed-4868-ba47-34673a2c373a None None] Enqueued Resource ID: 3832f856-a6cd-4edd-a7f5-4e3d09f7cc77 with Priority: HIGHEST for action port [ 789.045534] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3832f856-a6cd-4edd-a7f5-4e3d09f7cc77 with Priority: HIGHEST for action port [ 789.045623] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-3832f856-a6cd-4edd-a7f5-4e3d09f7cc77 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.045820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3832f856-a6cd-4edd-a7f5-4e3d09f7cc77" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.045984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3832f856-a6cd-4edd-a7f5-4e3d09f7cc77" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.046213] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3832f856-a6cd-4edd-a7f5-4e3d09f7cc77" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.046314] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3832f856-a6cd-4edd-a7f5-4e3d09f7cc77',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.549487] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3832f856-a6cd-4edd-a7f5-4e3d09f7cc77 [ 789.549701] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.549841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.549943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.550265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.550370] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.550472] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3832f856-a6cd-4edd-a7f5-4e3d09f7cc77 already deleted. [ 789.550557] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3832f856-a6cd-4edd-a7f5-4e3d09f7cc77" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.335334] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: SUCCESS [ 790.335680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.691903] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a in Status: SUCCESS [ 790.693320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.693543] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.693780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.693977] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.694208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.694269] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.694458] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.694520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.694579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.694680] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.197509] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.700010] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0bc7ffe-997e-4e93-849d-b293c0ee0e6a: rpc.has_security_group_logging(os_id): False [ 791.724155] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.724155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.724155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.724155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.724155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.724155] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.724155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.724155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.724155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.724155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.724155] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a is going to be updated. [ 791.798543] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.798716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.798849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.800756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.800756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.817130] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a in Status: IN_PROGRESS for 2s [ 792.409021] env[65102]: INFO networking_nsxv3.common.synchronization [None req-909a82c5-35e4-4d82-b77d-e7f6c9e156aa None None] Enqueued Resource ID: 57b5ce6e-aeec-49dc-a8e6-69d786cccd61 with Priority: HIGHEST for action port [ 792.409021] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b5ce6e-aeec-49dc-a8e6-69d786cccd61 with Priority: HIGHEST for action port [ 792.409021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-57b5ce6e-aeec-49dc-a8e6-69d786cccd61 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.409021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57b5ce6e-aeec-49dc-a8e6-69d786cccd61" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.409021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57b5ce6e-aeec-49dc-a8e6-69d786cccd61" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.409021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57b5ce6e-aeec-49dc-a8e6-69d786cccd61" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.409021] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57b5ce6e-aeec-49dc-a8e6-69d786cccd61',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.915427] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57b5ce6e-aeec-49dc-a8e6-69d786cccd61 [ 792.915705] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.917020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.917020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.917020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.917020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.917020] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57b5ce6e-aeec-49dc-a8e6-69d786cccd61 already deleted. [ 792.917020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57b5ce6e-aeec-49dc-a8e6-69d786cccd61" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.182472] env[65102]: INFO networking_nsxv3.common.synchronization [req-983ceb1a-5f7b-4db5-9482-b8397ea1e363 req-f199385d-30a1-490f-8dd0-fd07ff8dd42c tempest-AttachInterfacesUnderV243Test-1550338923 tempest-AttachInterfacesUnderV243Test-1550338923-project-member] Enqueued Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_members [ 793.182472] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_members [ 793.182983] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4d20b00-9518-4813-be00-1234d826f6c1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.183097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.183145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.183408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.183597] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.183725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.183811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.184644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.184644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.184644] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.212659] env[65102]: INFO networking_nsxv3.common.synchronization [req-983ceb1a-5f7b-4db5-9482-b8397ea1e363 req-f199385d-30a1-490f-8dd0-fd07ff8dd42c tempest-AttachInterfacesUnderV243Test-1550338923 tempest-AttachInterfacesUnderV243Test-1550338923-project-member] Enqueued Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_rules [ 793.212659] env[65102]: INFO networking_nsxv3.common.synchronization [req-983ceb1a-5f7b-4db5-9482-b8397ea1e363 req-f199385d-30a1-490f-8dd0-fd07ff8dd42c tempest-AttachInterfacesUnderV243Test-1550338923 tempest-AttachInterfacesUnderV243Test-1550338923-project-member] Enqueued Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_members [ 793.212659] env[65102]: INFO networking_nsxv3.common.synchronization [req-983ceb1a-5f7b-4db5-9482-b8397ea1e363 req-f199385d-30a1-490f-8dd0-fd07ff8dd42c tempest-AttachInterfacesUnderV243Test-1550338923 tempest-AttachInterfacesUnderV243Test-1550338923-project-member] Enqueued Resource ID: fa708f72-f0b6-4ac5-a002-0d6589e8ab0e with Priority: HIGHEST for action port [ 793.212659] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_rules [ 793.212659] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_members [ 793.212659] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa708f72-f0b6-4ac5-a002-0d6589e8ab0e with Priority: HIGHEST for action port [ 793.212659] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4d20b00-9518-4813-be00-1234d826f6c1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.212659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.212659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.212659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.212659] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.212659] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4d20b00-9518-4813-be00-1234d826f6c1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.213137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.213137] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.213137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.213325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.213439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.213948] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa708f72-f0b6-4ac5-a002-0d6589e8ab0e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.687211] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.718029] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa708f72-f0b6-4ac5-a002-0d6589e8ab0e with status ACTIVE [ 793.718029] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.718029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.718029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.718029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.718029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.718029] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.718029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.718029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.718029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.718029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.718029] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.718029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.718029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.718029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.718029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.718029] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa708f72-f0b6-4ac5-a002-0d6589e8ab0e is going to be updated. [ 793.720406] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4d20b00-9518-4813-be00-1234d826f6c1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.720533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.744283] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.744283] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.744421] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.745042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.745042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.745042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.843892] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a in Status: SUCCESS [ 793.844148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.192178] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.700254] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.700425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.700474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.700677] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.700768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.700867] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4d20b00-9518-4813-be00-1234d826f6c1 is going to be updated. [ 794.740238] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.740399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.741106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.741106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.741106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.752754] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4d20b00-9518-4813-be00-1234d826f6c1 in Status: IN_PROGRESS for 2s [ 794.943614] env[65102]: INFO networking_nsxv3.common.synchronization [req-df446457-d5da-4cad-94a2-3eb662dfddcb req-56f11b74-d311-4f60-b569-798aafc76c3d tempest-ImagesTestJSON-2026451637 tempest-ImagesTestJSON-2026451637-project-member] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 794.945861] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 794.946212] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.946428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.946606] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.947684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.947892] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.948010] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.948093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.948711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.948711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.948711] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.453622] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.453916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.453916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.454637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.454637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.454637] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.454637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.454637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.454832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.454832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.454899] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be updated. [ 795.487474] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.487474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.487474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.487686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.487907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.498200] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 796.714890] env[65102]: INFO networking_nsxv3.common.synchronization [req-b1d8ae04-3882-4e6e-993f-0bf8b7b6ba27 req-1cdefa98-eb9f-4fe8-80c0-d18942abf106 tempest-AttachInterfacesUnderV243Test-1550338923 tempest-AttachInterfacesUnderV243Test-1550338923-project-member] Enqueued Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_members [ 796.715254] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_members [ 796.715548] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4d20b00-9518-4813-be00-1234d826f6c1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.715548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.733121] env[65102]: INFO networking_nsxv3.common.synchronization [req-b1d8ae04-3882-4e6e-993f-0bf8b7b6ba27 req-1cdefa98-eb9f-4fe8-80c0-d18942abf106 tempest-AttachInterfacesUnderV243Test-1550338923 tempest-AttachInterfacesUnderV243Test-1550338923-project-member] Enqueued Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_rules [ 796.733304] env[65102]: INFO networking_nsxv3.common.synchronization [req-b1d8ae04-3882-4e6e-993f-0bf8b7b6ba27 req-1cdefa98-eb9f-4fe8-80c0-d18942abf106 tempest-AttachInterfacesUnderV243Test-1550338923 tempest-AttachInterfacesUnderV243Test-1550338923-project-member] Enqueued Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_members [ 796.733498] env[65102]: INFO networking_nsxv3.common.synchronization [req-b1d8ae04-3882-4e6e-993f-0bf8b7b6ba27 req-1cdefa98-eb9f-4fe8-80c0-d18942abf106 tempest-AttachInterfacesUnderV243Test-1550338923 tempest-AttachInterfacesUnderV243Test-1550338923-project-member] Enqueued Resource ID: fa708f72-f0b6-4ac5-a002-0d6589e8ab0e with Priority: HIGHEST for action port [ 796.733946] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_rules [ 796.734098] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_members [ 796.734271] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa708f72-f0b6-4ac5-a002-0d6589e8ab0e with Priority: HIGHEST for action port [ 796.736104] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4d20b00-9518-4813-be00-1234d826f6c1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.736271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.736499] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4d20b00-9518-4813-be00-1234d826f6c1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.736595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.736773] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.738234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.738234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.738234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.738234] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa708f72-f0b6-4ac5-a002-0d6589e8ab0e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.765929] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4d20b00-9518-4813-be00-1234d826f6c1 in Status: SUCCESS [ 796.765929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.765929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.765929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.765929] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.765929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.765929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.765929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.765929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.765929] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.241608] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa708f72-f0b6-4ac5-a002-0d6589e8ab0e with status ACTIVE [ 797.241900] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.242054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.242122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.242341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.242427] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.242613] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.242731] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.242794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.243201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.243201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.243201] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.243346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.243377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.243497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.244394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.244394] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa708f72-f0b6-4ac5-a002-0d6589e8ab0e is going to be updated. [ 797.269033] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.269248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.269248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.269465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.269615] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.270761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa708f72-f0b6-4ac5-a002-0d6589e8ab0e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.270761] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.512396] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 797.512396] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad deletion is rescheduled due to dependency. [ 797.512396] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.773788] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.278013] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.278013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.278013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.278013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.278013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.278013] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4d20b00-9518-4813-be00-1234d826f6c1 is going to be updated. [ 798.311388] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.311564] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.311564] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.312193] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.312193] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.323722] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4d20b00-9518-4813-be00-1234d826f6c1 in Status: IN_PROGRESS for 2s [ 800.337086] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4d20b00-9518-4813-be00-1234d826f6c1 in Status: SUCCESS [ 800.337647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.337754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.337998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.338608] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.338608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.338608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.338608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.338872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.338872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.338872] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.339797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.339987] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.340213] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.340316] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.340419] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.340485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.340591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.340634] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.843713] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.844712] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.985485] env[65102]: INFO networking_nsxv3.common.synchronization [req-acd4d17a-0933-4823-bbae-2790b99bda50 req-bc29bdef-2881-435b-aaa6-e4aaacb63bed tempest-AttachInterfacesUnderV243Test-1550338923 tempest-AttachInterfacesUnderV243Test-1550338923-project-member] Enqueued Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_members [ 800.986741] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4d20b00-9518-4813-be00-1234d826f6c1 with Priority: HIGHEST for action security_group_members [ 800.987390] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4d20b00-9518-4813-be00-1234d826f6c1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.987558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.346275] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4d20b00-9518-4813-be00-1234d826f6c1: rpc.has_security_group_logging(os_id): False [ 801.347444] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.368945] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.369184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.369269] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.369461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.391031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.391031] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.391031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.391031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.391305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.391305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.391365] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4d20b00-9518-4813-be00-1234d826f6c1 is going to be updated. [ 801.460642] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.460642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.460642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.460642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.460642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.477147] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4d20b00-9518-4813-be00-1234d826f6c1 in Status: IN_PROGRESS for 2s [ 801.850095] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.850281] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.850398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.850653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.850860] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.850860] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4d20b00-9518-4813-be00-1234d826f6c1 is going to be updated. [ 801.887946] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.888203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.888315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.888589] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.888761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.901277] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4d20b00-9518-4813-be00-1234d826f6c1 in Status: IN_PROGRESS for 2s [ 802.347603] env[65102]: INFO networking_nsxv3.common.synchronization [req-c9a182bc-0efc-42ad-b4ff-f11a1656d319 req-b409013d-da00-4101-905b-4cb460748373 tempest-ListImageFiltersTestJSON-812883063 tempest-ListImageFiltersTestJSON-812883063-project-member] Enqueued Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_members [ 802.347957] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGHEST for action security_group_members [ 802.348147] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.348309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.348358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.349654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.349654] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.349654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.349654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.349654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.350138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.350224] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.587442] env[65102]: INFO networking_nsxv3.common.synchronization [req-7f2f64e2-0dd7-4e9f-905f-06f0cd3dc633 req-5727bdf4-a640-427d-922e-4459dc38ea28 tempest-ServerActionsTestJSON-273915797 tempest-ServerActionsTestJSON-273915797-project-member] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 802.587997] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 802.588903] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.588903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.588903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.588903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.589143] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.589267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.589357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.589529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.589621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.589722] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.852051] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.852192] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.852238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.852479] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.878589] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.879403] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.879403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.879403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.879403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.879403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.879685] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 is going to be updated. [ 802.908734] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.908904] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.908992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.909259] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.909463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.919363] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 in Status: IN_PROGRESS for 2s [ 802.924162] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.924162] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.924325] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.924655] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.925268] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.925268] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.925268] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.925268] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.925550] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.925637] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.925748] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.925851] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.925953] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.926066] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.926165] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.926287] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.946927] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.947101] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 802.947749] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.947749] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.947749] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-cef8867b-7dd6-425a-b5db-760494cf6eb4 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.947919] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-cef8867b-7dd6-425a-b5db-760494cf6eb4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.948019] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-cef8867b-7dd6-425a-b5db-760494cf6eb4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.948357] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-cef8867b-7dd6-425a-b5db-760494cf6eb4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.948493] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cef8867b-7dd6-425a-b5db-760494cf6eb4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.092795] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.093011] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.093084] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.093312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.093415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.093633] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.093740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.093830] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.093961] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.094123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.094159] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b already deleted. [ 803.094231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.451018] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.451319] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.451403] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.452450] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.452450] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.452450] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port cef8867b-7dd6-425a-b5db-760494cf6eb4 not found, creating... [ 803.452450] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.452450] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.452717] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.452717] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.452826] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.453178] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.453291] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.453421] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.453625] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.453755] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.453891] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: cef8867b-7dd6-425a-b5db-760494cf6eb4 is going to be created. [ 803.477655] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.477655] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.477655] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.477655] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.477655] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.477655] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-cef8867b-7dd6-425a-b5db-760494cf6eb4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.495623] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4d20b00-9518-4813-be00-1234d826f6c1 in Status: SUCCESS [ 803.495623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.495623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.495843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.495969] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.911827] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4d20b00-9518-4813-be00-1234d826f6c1 in Status: SUCCESS [ 803.912071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.912228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.912608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.912675] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.912801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.912864] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.913052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.913129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.913219] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.019384] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.019577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.019621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.019845] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.019955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.020083] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4d20b00-9518-4813-be00-1234d826f6c1 is going to be deleted. [ 804.078310] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.078460] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.078535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.078821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.078916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.079054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.238116] env[65102]: INFO networking_nsxv3.common.synchronization [req-7f2f64e2-0dd7-4e9f-905f-06f0cd3dc633 req-a6528c35-41f1-42ff-9b1f-d8a6ac49095a service nova] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_rules [ 804.238578] env[65102]: INFO networking_nsxv3.common.synchronization [req-7f2f64e2-0dd7-4e9f-905f-06f0cd3dc633 req-a6528c35-41f1-42ff-9b1f-d8a6ac49095a service nova] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 804.238578] env[65102]: INFO networking_nsxv3.common.synchronization [req-7f2f64e2-0dd7-4e9f-905f-06f0cd3dc633 req-a6528c35-41f1-42ff-9b1f-d8a6ac49095a service nova] Enqueued Resource ID: cef8867b-7dd6-425a-b5db-760494cf6eb4 with Priority: HIGHEST for action port [ 804.238885] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_rules [ 804.239146] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 804.239292] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef8867b-7dd6-425a-b5db-760494cf6eb4 with Priority: HIGHEST for action port [ 804.239569] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.239690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.239773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.239971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.240072] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.241913] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.241913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.241913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.241913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.242136] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.242136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.242136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.242278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.242363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.242453] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.243775] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-cef8867b-7dd6-425a-b5db-760494cf6eb4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.243904] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cef8867b-7dd6-425a-b5db-760494cf6eb4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.244073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cef8867b-7dd6-425a-b5db-760494cf6eb4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.244238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cef8867b-7dd6-425a-b5db-760494cf6eb4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.244567] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cef8867b-7dd6-425a-b5db-760494cf6eb4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.415654] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.415932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.416073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.416596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.416596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.416798] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.416936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.417081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.417277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.417412] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.417530] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4d20b00-9518-4813-be00-1234d826f6c1 is going to be deleted. [ 804.452217] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.452644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.452644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.452644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.452745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.452837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.452998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.453280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.453357] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.453452] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.453508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.453645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.453722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.453814] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4d20b00-9518-4813-be00-1234d826f6c1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.742423] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.743037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.744953] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.746411] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cef8867b-7dd6-425a-b5db-760494cf6eb4 with status ACTIVE [ 804.746617] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.746740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.746811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.747031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.747122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.747833] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.747833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.747833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.747833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.747833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.748134] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.748134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.748134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.748255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.748288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.749132] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cef8867b-7dd6-425a-b5db-760494cf6eb4 is going to be updated. [ 804.769113] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.769262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.769333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.769545] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.769683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.769983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cef8867b-7dd6-425a-b5db-760494cf6eb4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.929936] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 in Status: SUCCESS [ 804.929936] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 deletion is rescheduled due to dependency. [ 804.930408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.955951] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.959700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.959794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.961162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.961162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.961162] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.961162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.961162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.961162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.961162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.961162] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4d20b00-9518-4813-be00-1234d826f6c1 already deleted. [ 804.961162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4d20b00-9518-4813-be00-1234d826f6c1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.247931] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.256235] env[65102]: INFO networking_nsxv3.common.synchronization [req-a994ddea-6ea7-42d5-ac4d-c950a5a5ef54 req-2c8c91b8-8e8c-4673-b739-b5cea1d8b94a tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 805.256719] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 805.257526] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.257679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.257679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.258181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.258439] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.258600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.259273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.259666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.259768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.259877] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.602556] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-16 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.602877] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-16" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.602877] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-16" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.603212] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-16" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.603476] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.603630] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.603745] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.603959] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.604133] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.604327] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.604436] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.604540] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.604643] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.604748] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.604850] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.604978] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.624267] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.624426] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 805.624555] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.624725] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-16" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.625041] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-bec67e7b-de92-407d-aef5-04d4430d3ee9 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.625212] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.625327] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.625637] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.625927] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bec67e7b-de92-407d-aef5-04d4430d3ee9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.751043] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.751043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.751043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.751439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.751439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.751439] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b is going to be created. [ 805.764956] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.764956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.764956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.765239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.765239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.765471] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.765641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.765993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.766191] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.766315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.766438] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f already deleted. [ 805.766553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.783710] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.783895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.783953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.784182] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.784355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.795839] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: UNINITIALIZED for 2s [ 806.128645] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.129207] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.129207] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.129609] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.129878] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.130240] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port bec67e7b-de92-407d-aef5-04d4430d3ee9 not found, creating... [ 806.130686] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.130942] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.131154] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.131514] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.132966] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.132966] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.132966] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.132966] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.132966] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.133277] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.133277] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: bec67e7b-de92-407d-aef5-04d4430d3ee9 is going to be created. [ 806.153877] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.154177] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.154331] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.154623] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.154871] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.155146] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.864319] env[65102]: INFO networking_nsxv3.common.synchronization [req-a994ddea-6ea7-42d5-ac4d-c950a5a5ef54 req-ae895c9c-f37a-460d-aa67-2c3db3c57552 service nova] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_rules [ 806.864319] env[65102]: INFO networking_nsxv3.common.synchronization [req-a994ddea-6ea7-42d5-ac4d-c950a5a5ef54 req-ae895c9c-f37a-460d-aa67-2c3db3c57552 service nova] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 806.864319] env[65102]: INFO networking_nsxv3.common.synchronization [req-a994ddea-6ea7-42d5-ac4d-c950a5a5ef54 req-ae895c9c-f37a-460d-aa67-2c3db3c57552 service nova] Enqueued Resource ID: bec67e7b-de92-407d-aef5-04d4430d3ee9 with Priority: HIGHEST for action port [ 806.864319] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_rules [ 806.864319] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 806.864319] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec67e7b-de92-407d-aef5-04d4430d3ee9 with Priority: HIGHEST for action port [ 806.864319] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.864319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.864319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.864319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.864319] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.865854] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.866122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.866369] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.866651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.866922] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.867212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.867445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.867710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.867931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.868155] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.869814] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-bec67e7b-de92-407d-aef5-04d4430d3ee9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.869814] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.869814] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.870035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.870078] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bec67e7b-de92-407d-aef5-04d4430d3ee9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.373023] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.374391] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.374391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.374745] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bec67e7b-de92-407d-aef5-04d4430d3ee9 with status ACTIVE [ 807.374939] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.375324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.375324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.375430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.375467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.375715] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.375881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.375881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.376035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.376077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.376282] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.376384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.376445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.376587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.376661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.376746] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bec67e7b-de92-407d-aef5-04d4430d3ee9 is going to be updated. [ 807.405132] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.405132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.405132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.405132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.405132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.405132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.808333] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: SUCCESS [ 807.808333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.808333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.808333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.808333] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.808333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.808333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.808333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.808333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.808333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.808333] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.875982] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.103017] env[65102]: INFO networking_nsxv3.common.synchronization [req-d8de6a90-562f-4ca7-b89a-e4d891d955e1 req-109c7e9a-4edf-4506-af79-51237e89035e tempest-VolumesAssistedSnapshotsTest-997297769 tempest-VolumesAssistedSnapshotsTest-997297769-project-member] Enqueued Resource ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c with Priority: HIGHEST for action security_group_members [ 808.103583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c with Priority: HIGHEST for action security_group_members [ 808.103894] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.104669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.104776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.105208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.105208] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.105449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.105449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.106109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.106217] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.106311] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('687f9a90-8cf8-4c0f-bfe9-b1800ef9665c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.310583] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.378171] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.379336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.379336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.379336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.379336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.379336] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be created. [ 808.402873] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.403041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.403093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.403294] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.403539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.413871] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: UNINITIALIZED for 2s [ 808.608752] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.609279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.609540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.609808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.632809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.633488] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.633488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.633488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.633488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.633690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.633690] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c is going to be updated. [ 808.661720] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.661720] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.661720] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.661967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.661967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.680863] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c in Status: IN_PROGRESS for 2s [ 808.812685] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29d98990-b866-4c6c-b1d9-41effdf1076b: rpc.has_security_group_logging(os_id): False [ 808.832421] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.832421] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.832598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.832671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.832777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.833043] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.833151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.833213] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.833397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.833477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.833574] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b is going to be created. [ 808.908442] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.908750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.908750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.908849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.909018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.923354] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: IN_PROGRESS for 2s [ 810.424673] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 810.424673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.424673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.425060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.425060] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.425155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.425155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.425332] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.425486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.425539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.425796] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.693643] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c in Status: SUCCESS [ 810.693643] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c deletion is rescheduled due to dependency. [ 810.693643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.931587] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.931587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.931587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.931587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.931587] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.931587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.931587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.931587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.931587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.931587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.931587] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.931587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.931587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.931587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.931587] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.931587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.932625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.932625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.932625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.932625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.932625] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.934715] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: SUCCESS [ 810.935136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.438352] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for daef1b5a-f25a-405c-9f5a-58444ec5510f: rpc.has_security_group_logging(os_id): False [ 811.459329] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.459537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.459616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.459815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.461136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.461136] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.461136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.461136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.461136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.461647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.461647] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.461647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.461647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.461802] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.461866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.462194] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.462278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.462353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.462522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.462655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.462806] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be created. [ 811.537376] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.537554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.537627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.538822] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.538822] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.551732] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 812.848757] env[65102]: INFO networking_nsxv3.common.synchronization [None req-59e55d6d-cfcc-4dbd-b583-fd532af3456a None None] Enqueued Resource ID: a38be89c-4035-403f-9fd1-d693ef205754 with Priority: HIGHEST for action port [ 812.849396] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a38be89c-4035-403f-9fd1-d693ef205754 with Priority: HIGHEST for action port [ 812.851194] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-a38be89c-4035-403f-9fd1-d693ef205754 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.851433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a38be89c-4035-403f-9fd1-d693ef205754" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.851433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a38be89c-4035-403f-9fd1-d693ef205754" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.851841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a38be89c-4035-403f-9fd1-d693ef205754" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.851957] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a38be89c-4035-403f-9fd1-d693ef205754',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.355781] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a38be89c-4035-403f-9fd1-d693ef205754 [ 813.355781] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.355781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.355781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.355781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.355781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.355781] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a38be89c-4035-403f-9fd1-d693ef205754 already deleted. [ 813.355781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a38be89c-4035-403f-9fd1-d693ef205754" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.566179] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 813.566416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.131909] env[65102]: INFO networking_nsxv3.common.synchronization [req-f2f76dbd-c567-4a7f-b9de-b895cddd86be req-c57bb852-cbac-49cd-8c49-08bae3e49db8 tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 814.132564] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 814.132910] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.133248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.133410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.133686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.133851] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.133954] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.134033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.134212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.134317] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.134414] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.169294] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.169457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.169512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.169721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.169839] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.426939] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.427179] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.427306] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.427582] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.427850] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.428019] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.428343] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.428492] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.428575] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.428788] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.428895] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.429008] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.429155] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.430047] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.430261] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.430460] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.457551] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.457661] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.457776] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.457958] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.458395] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-97579a1b-69c4-4b0c-b832-426f4d60592d taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.458652] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-97579a1b-69c4-4b0c-b832-426f4d60592d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.458759] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-97579a1b-69c4-4b0c-b832-426f4d60592d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.459027] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-97579a1b-69c4-4b0c-b832-426f4d60592d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.459141] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97579a1b-69c4-4b0c-b832-426f4d60592d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.637212] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.637505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.637505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.637653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.637776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.638021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.638478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.638478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.638478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.638629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.638629] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f already deleted. [ 814.638698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.673097] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.961231] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.961499] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.961585] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.961894] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.962074] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.962207] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 97579a1b-69c4-4b0c-b832-426f4d60592d not found, creating... [ 814.962861] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.962861] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.963090] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.963256] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.963395] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.963684] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.963838] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.963954] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.964208] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.964379] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.964525] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 97579a1b-69c4-4b0c-b832-426f4d60592d is going to be created. [ 814.988407] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.988699] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.988804] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.989112] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.989331] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.989552] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-97579a1b-69c4-4b0c-b832-426f4d60592d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.177185] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.290395] env[65102]: INFO networking_nsxv3.common.synchronization [None req-92821e19-2620-4433-934d-9e20a0c0f5c5 None None] Enqueued Resource ID: dc1e68c9-9c86-4f76-8499-daf791c1884d with Priority: HIGHEST for action port [ 815.290973] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc1e68c9-9c86-4f76-8499-daf791c1884d with Priority: HIGHEST for action port [ 815.291300] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc1e68c9-9c86-4f76-8499-daf791c1884d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.291424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc1e68c9-9c86-4f76-8499-daf791c1884d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.291585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc1e68c9-9c86-4f76-8499-daf791c1884d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.291863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc1e68c9-9c86-4f76-8499-daf791c1884d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.291922] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc1e68c9-9c86-4f76-8499-daf791c1884d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.679847] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 815.680016] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 815.697442] env[65102]: INFO networking_nsxv3.common.synchronization [req-f2f76dbd-c567-4a7f-b9de-b895cddd86be req-8aac82b9-0538-4a4a-8fe6-24b00be6cd96 service nova] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_rules [ 815.697618] env[65102]: INFO networking_nsxv3.common.synchronization [req-f2f76dbd-c567-4a7f-b9de-b895cddd86be req-8aac82b9-0538-4a4a-8fe6-24b00be6cd96 service nova] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 815.697750] env[65102]: INFO networking_nsxv3.common.synchronization [req-f2f76dbd-c567-4a7f-b9de-b895cddd86be req-8aac82b9-0538-4a4a-8fe6-24b00be6cd96 service nova] Enqueued Resource ID: 97579a1b-69c4-4b0c-b832-426f4d60592d with Priority: HIGHEST for action port [ 815.698448] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_rules [ 815.698664] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 815.698774] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97579a1b-69c4-4b0c-b832-426f4d60592d with Priority: HIGHEST for action port [ 815.699832] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.700069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.700197] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.700489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.700616] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.701804] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.701915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.701984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.702178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.702419] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.702624] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.704167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.704167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.704167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.704167] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.705562] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-97579a1b-69c4-4b0c-b832-426f4d60592d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.705706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97579a1b-69c4-4b0c-b832-426f4d60592d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.705767] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97579a1b-69c4-4b0c-b832-426f4d60592d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.705939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97579a1b-69c4-4b0c-b832-426f4d60592d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.706055] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97579a1b-69c4-4b0c-b832-426f4d60592d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.794374] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc1e68c9-9c86-4f76-8499-daf791c1884d [ 815.795457] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.795457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.795457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.795457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.795457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.795457] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc1e68c9-9c86-4f76-8499-daf791c1884d already deleted. [ 815.795782] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc1e68c9-9c86-4f76-8499-daf791c1884d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.207843] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.209236] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.209236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.213990] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97579a1b-69c4-4b0c-b832-426f4d60592d with status ACTIVE [ 816.214257] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.214537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.214629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.214829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.214920] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.215254] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.215254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.215381] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.215457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.215538] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.215755] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.215940] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.215996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.216147] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.216219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.216304] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97579a1b-69c4-4b0c-b832-426f4d60592d is going to be updated. [ 816.238344] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.238583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.238709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.239079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.239324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.239549] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97579a1b-69c4-4b0c-b832-426f4d60592d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.576785] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.577032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.577032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.577218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.591010] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 816.591010] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.591010] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 816.621268] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.621512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.621512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.621678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.628954] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.629325] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 816.629431] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.629489] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 816.672674] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.672847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.672916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.673159] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.674422] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.674621] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 816.711668] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.741404] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.741593] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.741593] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.741805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.742033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.742511] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 816.839600] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.839812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.839812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.839975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.840234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.840554] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:30. [ 816.841414] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0212d5d1-3785-49e1-b4e8-aaad4f538d18', '29f22186-8565-4d84-ad72-633756f6f315', '4a0d050a-9ee7-4daf-868e-6fdb6987f84c', 'b07f4606-a04e-468f-8194-7420bcbd987d', '4563a809-6b5f-4203-a94d-ff2468059ed7', '0c61af5d-d112-491b-97cd-9e037a2e5189', 'e67ea8b7-f278-4fbd-ba09-b18599f6e8ec', 'ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad', 'db36f333-73a7-4f6b-973f-e0c1b1ed809b', '645542ed-d50b-43c7-9870-1006fec2c84f', 'c6a41d40-0a8b-401c-801a-f31f69ae007f', '1d3a312b-7e77-4ed3-a5af-d7b832e0cef1', 'f5a72f78-b26f-4670-a8f0-eea902ebea26', '99c8f96e-2cdb-49cd-8847-bf7698ff539f', '29d98990-b866-4c6c-b1d9-41effdf1076b', '9b26f4e0-5f0f-411f-8e44-f73309220261', 'a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a', '568ad6ea-757e-4f5c-8f03-6cd3be52d2f1', '14808516-a2e0-455d-83e1-fa5b5fe0e828', '44148911-e2d1-4130-8398-a96a2ea96086', 'ce19aa8e-b26d-4484-8765-4894bdbb95a0', 'ad9ff44a-eecd-47a3-a497-f84ebc9294a5', '85b46990-bd7b-4abe-881c-9016519cf955', '48a0698b-8c00-4295-9ba0-bc4c6ebdca57', 'daef1b5a-f25a-405c-9f5a-58444ec5510f', 'a0bc7ffe-997e-4e93-849d-b293c0ee0e6a', 'e1e9f6d0-9fe0-49a8-a7c4-58871051f77d', '687f9a90-8cf8-4c0f-bfe9-b1800ef9665c', '220505b1-a182-4b77-b78e-66a35b312ba6', '1e4d0983-93de-4906-b7b5-69591bafe0fd'} {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.841414] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 816.866131] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.866131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.866131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.866131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.866131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.866131] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 816.866131] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.866131] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 816.935513] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.935701] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.935701] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.935983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.936740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.937277] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 816.937356] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 816.938063] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 816.938063] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 816.938063] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/30 resources of Type:Security Group Rules [ 816.938063] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGH for action security_group_rules [ 816.938063] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGH for action security_group_rules [ 816.938063] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c with Priority: HIGH for action security_group_rules [ 816.938063] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGH for action security_group_rules [ 816.938063] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 with Priority: HIGH for action security_group_rules [ 816.938063] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGH for action security_group_rules [ 816.938063] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec with Priority: HIGH for action security_group_rules [ 816.939583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGH for action security_group_rules [ 816.939583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b with Priority: HIGH for action security_group_rules [ 816.939583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 645542ed-d50b-43c7-9870-1006fec2c84f with Priority: HIGH for action security_group_rules [ 816.939583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGH for action security_group_rules [ 816.939583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGH for action security_group_rules [ 816.939583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGH for action security_group_rules [ 816.939583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGH for action security_group_rules [ 816.939583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGH for action security_group_rules [ 816.939583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 with Priority: HIGH for action security_group_rules [ 816.939583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGH for action security_group_rules [ 816.939583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGH for action security_group_rules [ 816.939583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGH for action security_group_rules [ 816.939583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44148911-e2d1-4130-8398-a96a2ea96086 with Priority: HIGH for action security_group_rules [ 816.939583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.128571] env[65102]: INFO networking_nsxv3.common.synchronization [req-74ddd1be-98b8-4f8e-a5e4-da01d4d7a94b req-b611497e-0bdb-4b5b-ab5a-25b45157f567 tempest-ServerTagsTestJSON-1705843489 tempest-ServerTagsTestJSON-1705843489-project-member] Enqueued Resource ID: c9efb249-50ca-405f-918d-507bd86040c4 with Priority: HIGHEST for action security_group_members [ 817.129553] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9efb249-50ca-405f-918d-507bd86040c4 with Priority: HIGHEST for action security_group_members [ 817.129553] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGH for action security_group_rules [ 817.129553] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c with Priority: HIGH for action security_group_rules [ 817.129553] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec with Priority: HIGH for action security_group_rules [ 817.129553] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGH for action security_group_rules [ 817.129553] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44148911-e2d1-4130-8398-a96a2ea96086 with Priority: HIGH for action security_group_rules [ 817.129553] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGH for action security_group_rules [ 817.129553] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 with Priority: HIGH for action security_group_rules [ 817.129902] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a with Priority: HIGH for action security_group_rules [ 817.129902] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGH for action security_group_rules [ 817.130068] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 with Priority: HIGH for action security_group_rules [ 817.130198] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGH for action security_group_rules [ 817.130340] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 with Priority: HIGH for action security_group_rules [ 817.130465] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGH for action security_group_rules [ 817.130623] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645542ed-d50b-43c7-9870-1006fec2c84f with Priority: HIGH for action security_group_rules [ 817.130762] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b with Priority: HIGH for action security_group_rules [ 817.130883] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGH for action security_group_rules [ 817.131013] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGH for action security_group_rules [ 817.131137] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 with Priority: HIGH for action security_group_rules [ 817.131259] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGH for action security_group_rules [ 817.131381] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGH for action security_group_rules [ 817.131932] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9efb249-50ca-405f-918d-507bd86040c4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.131932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.131932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.132267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.132483] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.132640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.132735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.132913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.133056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.133143] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9efb249-50ca-405f-918d-507bd86040c4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.134443] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.134657] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.134794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.134850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.134952] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.136475] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a0d050a-9ee7-4daf-868e-6fdb6987f84c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.136475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.136475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.136979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.136979] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a0d050a-9ee7-4daf-868e-6fdb6987f84c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.137507] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.137605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.138444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.138444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.138444] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e67ea8b7-f278-4fbd-ba09-b18599f6e8ec',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.139386] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.139386] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.139386] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.139578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.139578] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.142026] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44148911-e2d1-4130-8398-a96a2ea96086 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.142026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.142026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.142026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.142026] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44148911-e2d1-4130-8398-a96a2ea96086',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.148103] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14808516-a2e0-455d-83e1-fa5b5fe0e828 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.148270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.148348] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.148528] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.148610] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14808516-a2e0-455d-83e1-fa5b5fe0e828',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.149759] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.149898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.149971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.151067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.151183] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('568ad6ea-757e-4f5c-8f03-6cd3be52d2f1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.152229] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.152355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.152410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.152925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.152925] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.153639] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.153748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.153814] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.153966] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.155256] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.155998] env[65102]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 817.156338] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b26f4e0-5f0f-411f-8e44-f73309220261 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.156917] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.156917] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.156917] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.156917] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b26f4e0-5f0f-411f-8e44-f73309220261',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.157683] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.157789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.161137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.161137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.161137] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.161137] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.161137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.161137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.161137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.161137] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d3a312b-7e77-4ed3-a5af-d7b832e0cef1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.161137] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.161137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.161137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.161750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.161750] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.162266] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-645542ed-d50b-43c7-9870-1006fec2c84f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.162389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.162454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.162605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.162668] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('645542ed-d50b-43c7-9870-1006fec2c84f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.163735] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.163895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.163996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.164191] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.164269] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db36f333-73a7-4f6b-973f-e0c1b1ed809b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.165233] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c61af5d-d112-491b-97cd-9e037a2e5189 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.165336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.165401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.165586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.165691] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c61af5d-d112-491b-97cd-9e037a2e5189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.166913] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.167069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.167162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.167387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.167515] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.168669] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4563a809-6b5f-4203-a94d-ff2468059ed7 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.168784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.168845] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.168999] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.169114] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4563a809-6b5f-4203-a94d-ff2468059ed7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.170038] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29f22186-8565-4d84-ad72-633756f6f315 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.170197] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.170197] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.170375] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.170458] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29f22186-8565-4d84-ad72-633756f6f315',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.170717] env[65102]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 817.171464] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.171559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.171657] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.171854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.171936] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.177580] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.177780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.177860] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.178079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.178197] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.178405] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.178512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.178587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.178792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.178911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.179038] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9efb249-50ca-405f-918d-507bd86040c4 already deleted. [ 817.179147] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.181799] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.181909] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.181961] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.182602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.182602] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.182602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.182602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.182813] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.182852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.182941] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.183073] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.210819] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.210819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.210819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.210819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.218934] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.219091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.219142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.219376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.219467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.219563] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be created. [ 817.248152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.248396] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a0d050a-9ee7-4daf-868e-6fdb6987f84c is going to be deleted. [ 817.263485] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.263651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.263718] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.264256] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.264256] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.446268] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: UNINITIALIZED for 2s [ 817.451700] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.451961] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.451961] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.452145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.452221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.452334] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a0d050a-9ee7-4daf-868e-6fdb6987f84c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.573722] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-489 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.573931] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-489" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.574076] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-489" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.574400] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-489" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.574660] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.574812] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.574925] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.575151] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.575312] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.575523] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.575631] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 817.575747] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 817.575850] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 817.575953] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.576064] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 817.576330] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.597161] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.597325] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 817.597469] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.597629] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-489" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.597962] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-487dbf21-efa0-47ad-8919-f245c183a8ab taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.598155] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-487dbf21-efa0-47ad-8919-f245c183a8ab" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.598343] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-487dbf21-efa0-47ad-8919-f245c183a8ab" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.598695] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-487dbf21-efa0-47ad-8919-f245c183a8ab" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.598834] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('487dbf21-efa0-47ad-8919-f245c183a8ab',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.693581] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.733388] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c61af5d-d112-491b-97cd-9e037a2e5189 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.733388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.733388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.733388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.733388] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.733388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.733388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.733388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.733388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.733388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.733388] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c61af5d-d112-491b-97cd-9e037a2e5189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.736258] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.736258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.737244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.737244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.737244] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.737244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.737244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.737244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.737244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.737244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.737244] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.739562] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29f22186-8565-4d84-ad72-633756f6f315 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.739806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.739806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.740035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.740683] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.740683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.740683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.740683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.740683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.741108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.741108] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29f22186-8565-4d84-ad72-633756f6f315',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.744424] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.744532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.744625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.744756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.745145] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.745145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.745145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.745390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.745484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.745570] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.745639] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.746584] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-14808516-a2e0-455d-83e1-fa5b5fe0e828 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.746725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.746725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.746895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.747041] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.747383] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.747383] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.747383] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.747587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.747587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.747661] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14808516-a2e0-455d-83e1-fa5b5fe0e828',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.750994] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.751220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.751220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.751740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.751740] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.751740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.751740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.752077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.752077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.752295] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.752295] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.756146] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.756291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.756360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.756553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.756695] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.756795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.756859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.758134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.758134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.758134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.758134] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.767735] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c61af5d-d112-491b-97cd-9e037a2e5189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.808995] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.809222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.809297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.809510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.811750] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.811961] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.812705] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.812869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.813566] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.813666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.814400] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.814618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.815204] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.815293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.816071] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.816309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.817555] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.817653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.818405] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.818497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.819299] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.819436] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.820113] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.820207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.835557] env[65102]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 817.836213] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.836352] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d3a312b-7e77-4ed3-a5af-d7b832e0cef1 is going to be deleted. [ 817.837676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.837923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.857234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.857428] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4563a809-6b5f-4203-a94d-ff2468059ed7 is going to be deleted. [ 817.858539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.858761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.894882] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.897169] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e67ea8b7-f278-4fbd-ba09-b18599f6e8ec is going to be deleted. [ 817.897169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.897169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.920388] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.920388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.927395] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.927395] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db36f333-73a7-4f6b-973f-e0c1b1ed809b is going to be deleted. [ 817.927395] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.927679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.959595] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.959799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.977526] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.977526] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be deleted. [ 817.979032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.979032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.028681] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.029100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.041760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.041940] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a is going to be deleted. [ 818.045746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.045746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.066977] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.066977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.094239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.094414] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be deleted. [ 818.095611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.095907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.101381] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.101702] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.101854] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.102162] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.102373] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.102611] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 487dbf21-efa0-47ad-8919-f245c183a8ab not found, creating... [ 818.102993] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.103230] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.103384] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.103679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.103870] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.104286] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.104478] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.104597] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.104846] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.105256] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.105476] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 487dbf21-efa0-47ad-8919-f245c183a8ab is going to be created. [ 818.140192] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.140384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.156698] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.156895] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.157029] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.157304] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.157535] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.157765] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-487dbf21-efa0-47ad-8919-f245c183a8ab" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.165183] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.165339] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 568ad6ea-757e-4f5c-8f03-6cd3be52d2f1 is going to be deleted. [ 818.166385] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.166641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.195854] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0212d5d1-3785-49e1-b4e8-aaad4f538d18: rpc.has_security_group_logging(os_id): False [ 818.235036] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.235333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.243291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.243454] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b26f4e0-5f0f-411f-8e44-f73309220261 is going to be deleted. [ 818.244451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.244669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.254777] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.256073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.256448] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.262412] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.262603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.262757] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.262874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.262940] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.263209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.263712] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.263712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.263712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.263913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.263913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.263977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.264726] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.264726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.264726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.264726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.264726] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.264726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.265212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.265212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.265212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.265212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.265212] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.266185] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29f22186-8565-4d84-ad72-633756f6f315',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.268649] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.268649] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.268833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.268870] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.269076] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.269211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.269311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.269773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.269773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.269773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.269866] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.269926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.269972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.270127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.270303] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.270383] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.270439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.270551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.270747] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.270747] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.270822] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.271766] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.271847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.271992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.272061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.272182] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.272464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.272464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.272660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.272660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.272739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.273217] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.273217] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.273217] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.273217] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.273385] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.273385] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.273385] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.273519] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.273554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.274656] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.274656] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.275279] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14808516-a2e0-455d-83e1-fa5b5fe0e828',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.276155] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c61af5d-d112-491b-97cd-9e037a2e5189: rpc.has_security_group_logging(os_id): False [ 818.377956] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.378218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.383221] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.383358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.384361] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.384495] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 645542ed-d50b-43c7-9870-1006fec2c84f is going to be deleted. [ 818.385458] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.385681] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.462947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.462947] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44148911-e2d1-4130-8398-a96a2ea96086 is going to be deleted. [ 818.462947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.462947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.462947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.462947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d3a312b-7e77-4ed3-a5af-d7b832e0cef1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.462947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.462947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.462947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.462947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4563a809-6b5f-4203-a94d-ff2468059ed7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.464579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.464579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.464579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.464579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e67ea8b7-f278-4fbd-ba09-b18599f6e8ec" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.464579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.464579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.464579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.464579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db36f333-73a7-4f6b-973f-e0c1b1ed809b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.464579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.464579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.464579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.464579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.464579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.464579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.465127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.465127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.465127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.465127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.518876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.519915] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.519915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.519915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.519915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.519915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.519915] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be updated. [ 818.521241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.521418] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.521561] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.521716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a79cbe4e-6e0b-4aa4-bb2c-9b0dbddc2c9a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.521910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.522085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.524443] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.524567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.600408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.600694] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.600888] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.601011] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.601247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.601357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.601542] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 is going to be updated. [ 818.603994] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.604327] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.604403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.604465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b26f4e0-5f0f-411f-8e44-f73309220261" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.604611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.604766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.604848] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.604963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-568ad6ea-757e-4f5c-8f03-6cd3be52d2f1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.605972] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.606671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.606671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.606671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.606671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.606671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-645542ed-d50b-43c7-9870-1006fec2c84f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.629184] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.629416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.629416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.629826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.629826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.629931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44148911-e2d1-4130-8398-a96a2ea96086" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.759543] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29d98990-b866-4c6c-b1d9-41effdf1076b: rpc.has_security_group_logging(os_id): False [ 818.769380] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6a41d40-0a8b-401c-801a-f31f69ae007f: rpc.has_security_group_logging(os_id): False [ 818.775826] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5a72f78-b26f-4670-a8f0-eea902ebea26: rpc.has_security_group_logging(os_id): False [ 818.777600] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29f22186-8565-4d84-ad72-633756f6f315: rpc.has_security_group_logging(os_id): False [ 818.779142] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b07f4606-a04e-468f-8194-7420bcbd987d: rpc.has_security_group_logging(os_id): False [ 818.780628] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14808516-a2e0-455d-83e1-fa5b5fe0e828: rpc.has_security_group_logging(os_id): False [ 818.788847] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.789112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.789175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.789514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.789743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.823525] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.823835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.823835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.824196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.826928] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.827312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.828376] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.828694] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.829835] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.830038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.832318] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.832485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.833640] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.833805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.834846] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: IN_PROGRESS for 2s [ 818.836101] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.836271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.854828] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.855282] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.855459] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.855574] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.855859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.855990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.856320] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.856477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.856586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.856823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.856989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.857266] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.857389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.857492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.857725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.857847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.858013] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b07f4606-a04e-468f-8194-7420bcbd987d is going to be updated. [ 818.859689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.859957] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.895207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.895593] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.895713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.895806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.896081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.896368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.896495] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.896620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.896692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.896895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.897028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.897554] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.897554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.897554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.897761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.897761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.897876] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 is going to be updated. [ 818.899568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.899568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.922601] env[65102]: INFO networking_nsxv3.common.synchronization [req-74ddd1be-98b8-4f8e-a5e4-da01d4d7a94b req-80484a37-33fa-42dc-a9e6-cb85e155f1ea service nova] Enqueued Resource ID: c9efb249-50ca-405f-918d-507bd86040c4 with Priority: HIGHEST for action security_group_rules [ 818.922852] env[65102]: INFO networking_nsxv3.common.synchronization [req-74ddd1be-98b8-4f8e-a5e4-da01d4d7a94b req-80484a37-33fa-42dc-a9e6-cb85e155f1ea service nova] Enqueued Resource ID: c9efb249-50ca-405f-918d-507bd86040c4 with Priority: HIGHEST for action security_group_members [ 818.923054] env[65102]: INFO networking_nsxv3.common.synchronization [req-74ddd1be-98b8-4f8e-a5e4-da01d4d7a94b req-80484a37-33fa-42dc-a9e6-cb85e155f1ea service nova] Enqueued Resource ID: 487dbf21-efa0-47ad-8919-f245c183a8ab with Priority: HIGHEST for action port [ 818.923770] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9efb249-50ca-405f-918d-507bd86040c4 with Priority: HIGHEST for action security_group_rules [ 818.924602] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9efb249-50ca-405f-918d-507bd86040c4 with Priority: HIGHEST for action security_group_members [ 818.924795] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 487dbf21-efa0-47ad-8919-f245c183a8ab with Priority: HIGHEST for action port [ 818.925072] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9efb249-50ca-405f-918d-507bd86040c4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.925374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.925374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.925560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.925737] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9efb249-50ca-405f-918d-507bd86040c4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.926989] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9efb249-50ca-405f-918d-507bd86040c4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.926989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.927169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.927278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.927809] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.927809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.927809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.927809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.927809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.928448] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9efb249-50ca-405f-918d-507bd86040c4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.928865] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-487dbf21-efa0-47ad-8919-f245c183a8ab taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.928981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-487dbf21-efa0-47ad-8919-f245c183a8ab" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.929134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-487dbf21-efa0-47ad-8919-f245c183a8ab" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.929672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-487dbf21-efa0-47ad-8919-f245c183a8ab" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.929672] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('487dbf21-efa0-47ad-8919-f245c183a8ab',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.945069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.945496] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.945673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.945780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.946202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.946590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.946786] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29f22186-8565-4d84-ad72-633756f6f315 is going to be updated. [ 818.949534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.949761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.992945] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.993070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.994763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.998864] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.999243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.999407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.999598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.999721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.000104] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.000268] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.000329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.000544] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.000707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.001019] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.001179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.001179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.003164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.003705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.003705] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be updated. [ 819.004840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.005108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.036334] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.036805] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.036982] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.037949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.037949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.037949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.037949] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 is going to be updated. [ 819.038887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.039068] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.039216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.040546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.040671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.040790] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.041790] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.041976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.083598] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.083598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.084347] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.084684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.088853] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 in Status: IN_PROGRESS for 2s [ 819.119513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.120046] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.120194] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.120194] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.120422] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.120517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.120742] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b is going to be updated. [ 819.122026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.122479] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.122680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.123810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.124045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.124245] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.125958] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: IN_PROGRESS for 2s [ 819.152290] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.152571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.152571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.152790] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.152892] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.155365] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29f22186-8565-4d84-ad72-633756f6f315 in Status: IN_PROGRESS for 2s [ 819.156839] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: IN_PROGRESS for 2s [ 819.216367] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.216367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.216367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.216367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.216367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.220822] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 in Status: IN_PROGRESS for 2s [ 819.331053] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.331424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.331424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.331500] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.331640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.335577] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 819.362547] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: IN_PROGRESS for 2s [ 819.431386] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9efb249-50ca-405f-918d-507bd86040c4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.432317] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9efb249-50ca-405f-918d-507bd86040c4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.432538] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.432814] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 487dbf21-efa0-47ad-8919-f245c183a8ab with status ACTIVE [ 819.433022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.433214] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.433214] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.433373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.433487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.433678] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.433761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.433821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.433987] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.434073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.434257] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.434378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.434440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.434579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.434654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.434743] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 487dbf21-efa0-47ad-8919-f245c183a8ab is going to be updated. [ 819.457181] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 819.457495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.457590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.458273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.458273] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.458273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.458273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.458831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.458831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.458831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.458831] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.475043] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.475043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.475043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.475390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.475390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.475465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-487dbf21-efa0-47ad-8919-f245c183a8ab" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.934272] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9efb249-50ca-405f-918d-507bd86040c4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.961362] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.961633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.961722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.961975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.962528] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.962732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.962968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.963117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.963225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.963345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.964103] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.964103] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.964103] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.964103] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.964103] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.964399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.964399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.964465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.964514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.964605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.964710] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.438545] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.439420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.439518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.439779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.439879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.440027] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9efb249-50ca-405f-918d-507bd86040c4 is going to be created. [ 820.467422] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59c26ae1-e2ae-453d-a285-e702cf89832f: rpc.has_security_group_logging(os_id): False [ 820.481029] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.481029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.481029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.481029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.481029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.489583] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.489800] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.489846] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.490089] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.490195] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.490339] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.490444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.490499] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.490676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.490788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.490971] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.491242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.491242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.491395] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.491395] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.491572] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.491670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.491728] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.491885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.491975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.492270] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be created. [ 820.497280] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9efb249-50ca-405f-918d-507bd86040c4 in Status: UNINITIALIZED for 2s [ 820.574359] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.574757] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.575098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.575433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.575760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.594743] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 820.687751] env[65102]: INFO networking_nsxv3.common.synchronization [req-b26ac762-1c53-40d8-b41f-0dd3b53a83af req-2f49bb17-aad1-4f7f-8b1d-6dfd36610088 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGHEST for action security_group_members [ 820.697096] env[65102]: INFO networking_nsxv3.common.synchronization [req-b26ac762-1c53-40d8-b41f-0dd3b53a83af req-2f49bb17-aad1-4f7f-8b1d-6dfd36610088 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 820.697096] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGHEST for action security_group_members [ 820.697096] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 820.697096] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.697096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.697096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.697096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.697096] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.697096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.697096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.697096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.697096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.697096] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.702550] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.702550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.702550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.702550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.702550] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.702550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.702550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.702550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.702550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.702550] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.766219] env[65102]: INFO networking_nsxv3.common.synchronization [req-b26ac762-1c53-40d8-b41f-0dd3b53a83af req-2f49bb17-aad1-4f7f-8b1d-6dfd36610088 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGHEST for action security_group_rules [ 820.766622] env[65102]: INFO networking_nsxv3.common.synchronization [req-b26ac762-1c53-40d8-b41f-0dd3b53a83af req-2f49bb17-aad1-4f7f-8b1d-6dfd36610088 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGHEST for action security_group_members [ 820.766683] env[65102]: INFO networking_nsxv3.common.synchronization [req-b26ac762-1c53-40d8-b41f-0dd3b53a83af req-2f49bb17-aad1-4f7f-8b1d-6dfd36610088 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_rules [ 820.766847] env[65102]: INFO networking_nsxv3.common.synchronization [req-b26ac762-1c53-40d8-b41f-0dd3b53a83af req-2f49bb17-aad1-4f7f-8b1d-6dfd36610088 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 820.767100] env[65102]: INFO networking_nsxv3.common.synchronization [req-b26ac762-1c53-40d8-b41f-0dd3b53a83af req-2f49bb17-aad1-4f7f-8b1d-6dfd36610088 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: bec67e7b-de92-407d-aef5-04d4430d3ee9 with Priority: HIGHEST for action port [ 820.768153] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGHEST for action security_group_rules [ 820.768383] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_rules [ 820.768762] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec67e7b-de92-407d-aef5-04d4430d3ee9 with Priority: HIGHEST for action port [ 820.768996] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGHEST for action security_group_members [ 820.769202] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 820.770083] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.770539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.770539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.770747] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.771019] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.772142] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.772333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.772333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.772601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.772672] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.773789] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-bec67e7b-de92-407d-aef5-04d4430d3ee9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.773929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.773996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.774280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.774353] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bec67e7b-de92-407d-aef5-04d4430d3ee9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.775660] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.775660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.775885] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.775885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.865805] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 820.866498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.102666] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 in Status: SUCCESS [ 821.102921] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.139824] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: SUCCESS [ 821.140199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.169735] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29f22186-8565-4d84-ad72-633756f6f315 in Status: SUCCESS [ 821.170027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.171916] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: SUCCESS [ 821.172051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.203667] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.205044] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.235626] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 in Status: SUCCESS [ 821.235930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.279413] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.279413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.279413] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bec67e7b-de92-407d-aef5-04d4430d3ee9 with status ACTIVE [ 821.279413] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.279413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.279413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.279413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.279413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.279413] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.279413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.279413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.279413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.279413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.279924] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.279924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.279924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.279924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.279924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.279924] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bec67e7b-de92-407d-aef5-04d4430d3ee9 is going to be updated. [ 821.281724] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.281724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.304057] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.304314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.304314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.304527] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.304673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.304838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.385832] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 821.386109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.393593] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: SUCCESS [ 821.393963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.708728] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.709729] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.204415] env[65102]: INFO networking_nsxv3.common.synchronization [None req-381eafda-c04e-4a72-bc1d-514fbae5e0b5 None None] Enqueued Resource ID: f8fc893d-c510-4558-a94d-80db03c86103 with Priority: HIGHEST for action port [ 822.204685] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8fc893d-c510-4558-a94d-80db03c86103 with Priority: HIGHEST for action port [ 822.205309] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8fc893d-c510-4558-a94d-80db03c86103 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.205436] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8fc893d-c510-4558-a94d-80db03c86103" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.205508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8fc893d-c510-4558-a94d-80db03c86103" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.205768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8fc893d-c510-4558-a94d-80db03c86103" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.205842] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8fc893d-c510-4558-a94d-80db03c86103',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.212693] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.212860] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.212925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.213141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.213414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.213414] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 is going to be created. [ 822.214566] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.214672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.214737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.214900] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.214977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.215085] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 822.239697] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.239797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.239872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.240120] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.240293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.244366] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.244562] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.244562] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.244780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.244960] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.250436] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 in Status: UNINITIALIZED for 2s [ 822.252617] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 822.524242] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9efb249-50ca-405f-918d-507bd86040c4 in Status: SUCCESS [ 822.524461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.524632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.524857] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.525071] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.525182] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.525244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.525389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.525465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.525547] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.525635] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9efb249-50ca-405f-918d-507bd86040c4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.620539] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 822.620539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.708097] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8fc893d-c510-4558-a94d-80db03c86103 [ 822.708559] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.708559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.708559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.708760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.708990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.709073] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8fc893d-c510-4558-a94d-80db03c86103 already deleted. [ 822.709160] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8fc893d-c510-4558-a94d-80db03c86103" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.028776] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9efb249-50ca-405f-918d-507bd86040c4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.029360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.029360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.029360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.029603] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.029603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.029724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.029989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.030124] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.030300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.030694] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9efb249-50ca-405f-918d-507bd86040c4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.030694] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.030979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.031399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.032106] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.032392] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.032464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.032915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.032915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.033033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.033167] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9efb249-50ca-405f-918d-507bd86040c4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.254025] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb625708-1299-4152-a6a2-f513b80c9354 req-64da7046-dd16-415f-bf19-9a87e7cbad04 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 823.254025] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb625708-1299-4152-a6a2-f513b80c9354 req-64da7046-dd16-415f-bf19-9a87e7cbad04 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 082ce940-517e-4ecd-a42e-d7d185e47139 with Priority: HIGHEST for action security_group_members [ 823.254025] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb625708-1299-4152-a6a2-f513b80c9354 req-64da7046-dd16-415f-bf19-9a87e7cbad04 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGHEST for action security_group_members [ 823.254025] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 823.254025] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 082ce940-517e-4ecd-a42e-d7d185e47139 with Priority: HIGHEST for action security_group_members [ 823.254025] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGHEST for action security_group_members [ 823.254025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.254025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.254025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-082ce940-517e-4ecd-a42e-d7d185e47139 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.254025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.254025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.254025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.254025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.254025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.254025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.254025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.254025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.255233] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('082ce940-517e-4ecd-a42e-d7d185e47139',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.255233] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.255233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.357288] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb625708-1299-4152-a6a2-f513b80c9354 req-64da7046-dd16-415f-bf19-9a87e7cbad04 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 082ce940-517e-4ecd-a42e-d7d185e47139 with Priority: HIGHEST for action security_group_rules [ 823.357536] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb625708-1299-4152-a6a2-f513b80c9354 req-64da7046-dd16-415f-bf19-9a87e7cbad04 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 082ce940-517e-4ecd-a42e-d7d185e47139 with Priority: HIGHEST for action security_group_members [ 823.357720] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb625708-1299-4152-a6a2-f513b80c9354 req-64da7046-dd16-415f-bf19-9a87e7cbad04 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGHEST for action security_group_rules [ 823.357891] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb625708-1299-4152-a6a2-f513b80c9354 req-64da7046-dd16-415f-bf19-9a87e7cbad04 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGHEST for action security_group_members [ 823.358041] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb625708-1299-4152-a6a2-f513b80c9354 req-64da7046-dd16-415f-bf19-9a87e7cbad04 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_rules [ 823.358196] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb625708-1299-4152-a6a2-f513b80c9354 req-64da7046-dd16-415f-bf19-9a87e7cbad04 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 823.358327] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb625708-1299-4152-a6a2-f513b80c9354 req-64da7046-dd16-415f-bf19-9a87e7cbad04 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: bec67e7b-de92-407d-aef5-04d4430d3ee9 with Priority: HIGHEST for action port [ 823.359204] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 082ce940-517e-4ecd-a42e-d7d185e47139 with Priority: HIGHEST for action security_group_rules [ 823.359296] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGHEST for action security_group_rules [ 823.359403] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 823.359514] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec67e7b-de92-407d-aef5-04d4430d3ee9 with Priority: HIGHEST for action port [ 823.359623] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_rules [ 823.359717] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 082ce940-517e-4ecd-a42e-d7d185e47139 with Priority: HIGHEST for action security_group_members [ 823.360033] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGHEST for action security_group_members [ 823.360508] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-082ce940-517e-4ecd-a42e-d7d185e47139 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.360655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.360723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.361039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.361136] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('082ce940-517e-4ecd-a42e-d7d185e47139',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.362573] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.368019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.368019] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.368019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.368019] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-bec67e7b-de92-407d-aef5-04d4430d3ee9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.368019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.368019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.368019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.368019] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bec67e7b-de92-407d-aef5-04d4430d3ee9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.368887] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.370065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.370349] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-082ce940-517e-4ecd-a42e-d7d185e47139 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.370472] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.371420] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.371530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.538031] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9efb249-50ca-405f-918d-507bd86040c4: rpc.has_security_group_logging(os_id): False [ 823.560521] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.560737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.560822] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.561052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.561145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.561362] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.561495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.561565] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.561745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.561827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.562030] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.562130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.562184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.562334] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.562402] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.563672] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.563672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.563672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.563672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.563672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.563672] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9efb249-50ca-405f-918d-507bd86040c4 is going to be created. [ 823.646896] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.647044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.649991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.649991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.649991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.662458] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9efb249-50ca-405f-918d-507bd86040c4 in Status: IN_PROGRESS for 2s [ 823.757883] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('082ce940-517e-4ecd-a42e-d7d185e47139',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.873068] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-082ce940-517e-4ecd-a42e-d7d185e47139 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.873207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.873369] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bec67e7b-de92-407d-aef5-04d4430d3ee9 with status ACTIVE [ 823.873540] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.873648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.873714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.873925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.874026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.874204] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.874299] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.874359] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.874510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.874586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.874768] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.874859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.874918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.875073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.875147] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.875233] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bec67e7b-de92-407d-aef5-04d4430d3ee9 is going to be updated. [ 823.900940] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.900940] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.900940] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.900940] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.900940] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.900940] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bec67e7b-de92-407d-aef5-04d4430d3ee9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.262064] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 in Status: SUCCESS [ 824.262064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.262370] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('082ce940-517e-4ecd-a42e-d7d185e47139',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.266190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.266452] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.266685] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.266826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.266891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.267046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.267211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.268075] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.270367] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 824.271023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.271023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.271215] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.272099] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.272099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.272099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.272099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.272099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.272099] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.772468] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.772893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.772893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.772893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.773035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.773092] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 082ce940-517e-4ecd-a42e-d7d185e47139 is going to be created. [ 824.774722] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.776874] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.804022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.804022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.804022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.804022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.804022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.816224] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 082ce940-517e-4ecd-a42e-d7d185e47139 in Status: UNINITIALIZED for 2s [ 824.950058] env[65102]: INFO networking_nsxv3.common.synchronization [None req-a07644ac-26e5-4569-bd0a-208123f74262 None None] Enqueued Resource ID: ab5f0b6c-49e4-4d31-98b9-01dfd84b3b03 with Priority: HIGHEST for action port [ 824.950337] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab5f0b6c-49e4-4d31-98b9-01dfd84b3b03 with Priority: HIGHEST for action port [ 824.950737] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab5f0b6c-49e4-4d31-98b9-01dfd84b3b03 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.950876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab5f0b6c-49e4-4d31-98b9-01dfd84b3b03" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.950961] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab5f0b6c-49e4-4d31-98b9-01dfd84b3b03" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.951480] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab5f0b6c-49e4-4d31-98b9-01dfd84b3b03" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.951592] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab5f0b6c-49e4-4d31-98b9-01dfd84b3b03',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.006886] env[65102]: INFO networking_nsxv3.common.synchronization [None req-192cf2ac-d8af-4ca6-8d6c-e2362797e17c tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 with Priority: HIGHEST for action security_group_rules [ 825.007715] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 with Priority: HIGHEST for action security_group_rules [ 825.008104] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.008264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.008338] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.008628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.008737] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('351e6bc8-ffc9-4dca-ac8a-98595980ddc4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.118149] env[65102]: INFO networking_nsxv3.common.synchronization [None req-17e8b34a-68b7-4bd7-a37e-6a4e40b0db0b tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 with Priority: HIGHEST for action security_group_rules [ 825.118149] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 with Priority: HIGHEST for action security_group_rules [ 825.121415] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.121415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.279429] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.281141] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.418975] env[65102]: INFO networking_nsxv3.common.synchronization [req-765f0225-67c4-4306-be0d-bbfc5354294f req-6adf51fe-fc93-47c5-8496-3fabf54443f6 tempest-ServersAdminTestJSON-1629823880 tempest-ServersAdminTestJSON-1629823880-project-member] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 825.419557] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 825.420023] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.420131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.420131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.420320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.420471] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.420571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.420771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.420771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.420971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.420971] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.454706] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab5f0b6c-49e4-4d31-98b9-01dfd84b3b03 [ 825.454937] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.455086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.455153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.455360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.455448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.455545] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab5f0b6c-49e4-4d31-98b9-01dfd84b3b03 already deleted. [ 825.455631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab5f0b6c-49e4-4d31-98b9-01dfd84b3b03" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.533022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.533022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.533022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.533022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.533022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.533022] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 already deleted. [ 825.533022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.533022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.533022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.533022] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('351e6bc8-ffc9-4dca-ac8a-98595980ddc4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.675969] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9efb249-50ca-405f-918d-507bd86040c4 in Status: SUCCESS [ 825.676075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.784175] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.784554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.784661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.784995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.784995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.785152] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 is going to be updated. [ 825.786515] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.786710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.786840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.786955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.787052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.787148] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 825.828076] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.828289] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.828367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.828584] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.828788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.830660] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.830787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.830851] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.831048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.831185] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.846814] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 in Status: IN_PROGRESS for 2s [ 825.846814] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 825.923365] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.058319] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.058538] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.058675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.058932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.059052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.059188] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 already deleted. [ 826.059722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.351922] env[65102]: INFO networking_nsxv3.common.synchronization [req-36649a80-8cf7-45ac-9fa8-1f31b031d378 req-14efa60d-0dfd-4bd2-8fc3-ab3b17553362 tempest-VolumesAdminNegativeTest-870844795 tempest-VolumesAdminNegativeTest-870844795-project-member] Enqueued Resource ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a with Priority: HIGHEST for action security_group_members [ 826.352438] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a with Priority: HIGHEST for action security_group_members [ 826.352751] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e0a8011-b557-40dd-b9b5-481c08d0040a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.352917] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.353335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.353648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.353859] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.353998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.354058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.354247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.354351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.354467] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e0a8011-b557-40dd-b9b5-481c08d0040a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.427351] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.722149] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-97 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.722467] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-97" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.722673] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-97" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.723307] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-97" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.723726] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.723984] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.724244] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.724543] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.724777] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.725201] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.725396] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.725582] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.725765] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.725957] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.726179] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.726401] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.746404] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.746627] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 826.746822] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.747102] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-97" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.747479] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-535ab747-8154-4faf-ae33-4f3a850a5dfb taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.747715] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-535ab747-8154-4faf-ae33-4f3a850a5dfb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.747887] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-535ab747-8154-4faf-ae33-4f3a850a5dfb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.748326] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-535ab747-8154-4faf-ae33-4f3a850a5dfb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.748524] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('535ab747-8154-4faf-ae33-4f3a850a5dfb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.828083] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 082ce940-517e-4ecd-a42e-d7d185e47139 in Status: SUCCESS [ 826.828083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.828083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.828083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.828083] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.828083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.828083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.828083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.828083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.828083] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('082ce940-517e-4ecd-a42e-d7d185e47139',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.856692] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.856692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.856692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.856905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.856905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.857623] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.857623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.857623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.857623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.857623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.857623] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a already deleted. [ 826.857623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.932309] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.932480] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.932545] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.932740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.932835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.932935] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be updated. [ 826.964080] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.964262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.964307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.964507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.965344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.976923] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 827.255133] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.255133] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.255133] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.255133] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.255133] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.255133] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 535ab747-8154-4faf-ae33-4f3a850a5dfb not found, creating... [ 827.255133] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.255133] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.255133] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.255607] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.255607] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.255974] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.256158] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.256268] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.256587] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.256977] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.257065] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 535ab747-8154-4faf-ae33-4f3a850a5dfb is going to be created. [ 827.283346] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.283575] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.283679] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.283964] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.284294] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.284522] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-535ab747-8154-4faf-ae33-4f3a850a5dfb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.330878] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('082ce940-517e-4ecd-a42e-d7d185e47139',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.835887] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('082ce940-517e-4ecd-a42e-d7d185e47139',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.857163] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 827.857566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.857787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.858096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.858361] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.858532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.858753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.858862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.859007] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.859164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.859300] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.860767] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 in Status: SUCCESS [ 827.861370] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.861370] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.861370] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.861517] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.861517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.861613] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.861837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.861837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.861935] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.862870] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.863120] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.863188] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.864094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.864094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.864094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.864094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.864094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.864094] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.865723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.866928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.867815] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.867923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.867987] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.868162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.868240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.868324] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.978696] env[65102]: INFO networking_nsxv3.common.synchronization [req-36649a80-8cf7-45ac-9fa8-1f31b031d378 req-3fddf81c-c5ba-4e8a-8523-69628fd8d377 service nova] Enqueued Resource ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a with Priority: HIGHEST for action security_group_rules [ 827.979475] env[65102]: INFO networking_nsxv3.common.synchronization [req-36649a80-8cf7-45ac-9fa8-1f31b031d378 req-3fddf81c-c5ba-4e8a-8523-69628fd8d377 service nova] Enqueued Resource ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a with Priority: HIGHEST for action security_group_members [ 827.979994] env[65102]: INFO networking_nsxv3.common.synchronization [req-36649a80-8cf7-45ac-9fa8-1f31b031d378 req-3fddf81c-c5ba-4e8a-8523-69628fd8d377 service nova] Enqueued Resource ID: 535ab747-8154-4faf-ae33-4f3a850a5dfb with Priority: HIGHEST for action port [ 827.980607] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a with Priority: HIGHEST for action security_group_rules [ 827.980810] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a with Priority: HIGHEST for action security_group_members [ 827.980943] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 535ab747-8154-4faf-ae33-4f3a850a5dfb with Priority: HIGHEST for action port [ 827.981889] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e0a8011-b557-40dd-b9b5-481c08d0040a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.981889] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.982028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.982259] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.985627] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e0a8011-b557-40dd-b9b5-481c08d0040a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.985627] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e0a8011-b557-40dd-b9b5-481c08d0040a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.985627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.985627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.985627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.985627] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.985627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.985627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.985627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.985627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.985627] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e0a8011-b557-40dd-b9b5-481c08d0040a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.986219] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-535ab747-8154-4faf-ae33-4f3a850a5dfb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.986284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-535ab747-8154-4faf-ae33-4f3a850a5dfb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.986784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-535ab747-8154-4faf-ae33-4f3a850a5dfb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.986784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-535ab747-8154-4faf-ae33-4f3a850a5dfb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.986784] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('535ab747-8154-4faf-ae33-4f3a850a5dfb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.338502] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.338804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.338927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.339219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.339380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.339519] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 082ce940-517e-4ecd-a42e-d7d185e47139 is going to be updated. [ 828.366450] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.366450] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.366450] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.370099] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.370986] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.374905] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.374905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.374905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.374905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.374905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.386558] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 082ce940-517e-4ecd-a42e-d7d185e47139 in Status: IN_PROGRESS for 2s [ 828.460810] env[65102]: INFO networking_nsxv3.common.synchronization [req-604a1359-c15e-4ae8-b790-ce5a93a92d76 req-171794f2-7707-4863-a8f4-83295ec9059f tempest-ImagesTestJSON-2026451637 tempest-ImagesTestJSON-2026451637-project-member] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 828.462770] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 828.463200] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.463427] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.463427] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.463612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.463811] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.463862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.463988] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.464785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.464785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.464785] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.489289] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e0a8011-b557-40dd-b9b5-481c08d0040a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.490937] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e0a8011-b557-40dd-b9b5-481c08d0040a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.491086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.492978] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 535ab747-8154-4faf-ae33-4f3a850a5dfb with status ACTIVE [ 828.492978] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.492978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.492978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.492978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.492978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.492978] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.492978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.492978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.492978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.492978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.493505] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.493505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.493505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.493505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.493645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.493645] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 535ab747-8154-4faf-ae33-4f3a850a5dfb is going to be updated. [ 828.522167] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.522611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.522853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.523172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.523472] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.523762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-535ab747-8154-4faf-ae33-4f3a850a5dfb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.801271] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.801468] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.801591] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.801850] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.802126] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.802293] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.802456] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.802680] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.802844] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.803084] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.803198] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.803318] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.803421] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.803555] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.803674] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.803855] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.822375] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.822551] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 828.822685] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.822865] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.823196] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-acc9d6b8-be91-4755-a23c-2c530ae497fe taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.823367] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-acc9d6b8-be91-4755-a23c-2c530ae497fe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.823486] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-acc9d6b8-be91-4755-a23c-2c530ae497fe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.823807] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-acc9d6b8-be91-4755-a23c-2c530ae497fe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.823978] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acc9d6b8-be91-4755-a23c-2c530ae497fe',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.870674] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.877199] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14: rpc.has_security_group_logging(os_id): False [ 828.879623] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.896814] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.896960] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.897043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.897262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.897353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.897582] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.897684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.897751] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.897906] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.897983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.898132] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 is going to be created. [ 828.964912] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.965112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.965196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.965358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.965535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.967292] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.967417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.967486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.967747] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.967747] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.967952] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.968076] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.968076] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.968204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.968261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.968349] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be deleted. [ 828.979978] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 in Status: IN_PROGRESS for 2s [ 828.989840] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 828.990322] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.996667] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e0a8011-b557-40dd-b9b5-481c08d0040a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.000035] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.000268] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.000366] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.001360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.001360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.001360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.326998] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.327409] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.327588] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.328052] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.328310] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.328566] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port acc9d6b8-be91-4755-a23c-2c530ae497fe not found, creating... [ 829.329031] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.329298] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.329491] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.329869] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.330097] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.330573] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.330829] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.331042] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.331380] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.331610] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.331831] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: acc9d6b8-be91-4755-a23c-2c530ae497fe is going to be created. [ 829.357633] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.357861] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.357988] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.358651] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.358651] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.358961] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-acc9d6b8-be91-4755-a23c-2c530ae497fe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.368155] env[65102]: INFO networking_nsxv3.common.synchronization [req-52f6a7a0-1ee7-4135-ac73-ea32afcbaed1 req-70aff32b-d31c-4379-a3c4-093cb35747a6 tempest-FloatingIPsAssociationTestJSON-1065123087 tempest-FloatingIPsAssociationTestJSON-1065123087-project-member] Enqueued Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_members [ 829.368835] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGHEST for action security_group_members [ 829.369248] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.369485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.369485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.369906] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.369906] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.369906] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.370172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.370172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.370308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.370308] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.373019] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.373214] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.373214] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.373379] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.373468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.373569] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 829.380995] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.381314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.381314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.381572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.381715] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.382241] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 is going to be updated. [ 829.420603] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.421388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.421388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.421388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.421388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.433708] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.434203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.434203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.436030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.436030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.445767] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 in Status: IN_PROGRESS for 2s [ 829.446309] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 829.499454] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.499864] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.499864] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.500180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.500294] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.500424] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a is going to be created. [ 829.542381] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.542633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.542633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.542773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.542983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.556469] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a in Status: UNINITIALIZED for 2s [ 829.874196] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.874196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.874196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.874196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.874196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.874196] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.874196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.874196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.874196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.874196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.874196] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b07f4606-a04e-468f-8194-7420bcbd987d is going to be updated. [ 829.908328] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.908430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.908469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.908818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.909982] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.920784] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: IN_PROGRESS for 2s [ 830.157201] env[65102]: INFO networking_nsxv3.common.synchronization [req-604a1359-c15e-4ae8-b790-ce5a93a92d76 req-8fa4c81e-c0b9-47c9-860c-032058116267 service nova] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_rules [ 830.157201] env[65102]: INFO networking_nsxv3.common.synchronization [req-604a1359-c15e-4ae8-b790-ce5a93a92d76 req-8fa4c81e-c0b9-47c9-860c-032058116267 service nova] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 830.157201] env[65102]: INFO networking_nsxv3.common.synchronization [req-604a1359-c15e-4ae8-b790-ce5a93a92d76 req-8fa4c81e-c0b9-47c9-860c-032058116267 service nova] Enqueued Resource ID: acc9d6b8-be91-4755-a23c-2c530ae497fe with Priority: HIGHEST for action port [ 830.157894] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_rules [ 830.158174] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 830.158403] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acc9d6b8-be91-4755-a23c-2c530ae497fe with Priority: HIGHEST for action port [ 830.158992] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.159262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.159492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.159850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.160131] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.162533] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.162533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.162533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.164489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.164489] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.164489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.164489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.164489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.164489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.164489] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.165792] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-acc9d6b8-be91-4755-a23c-2c530ae497fe taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.165792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acc9d6b8-be91-4755-a23c-2c530ae497fe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.165792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acc9d6b8-be91-4755-a23c-2c530ae497fe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.165792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acc9d6b8-be91-4755-a23c-2c530ae497fe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.165792] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acc9d6b8-be91-4755-a23c-2c530ae497fe',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.399743] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 082ce940-517e-4ecd-a42e-d7d185e47139 in Status: SUCCESS [ 830.399848] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.400107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.400409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.400664] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.400803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.400955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.401180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.401289] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.401400] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.401805] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('082ce940-517e-4ecd-a42e-d7d185e47139',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.668284] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.668284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.668545] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.669874] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acc9d6b8-be91-4755-a23c-2c530ae497fe with status ACTIVE [ 830.669966] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.670071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.670158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.670420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.670641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.670688] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.670790] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.670844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.671016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.671266] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.671487] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.671660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.671696] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.671858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.671954] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.672392] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acc9d6b8-be91-4755-a23c-2c530ae497fe is going to be updated. [ 830.696233] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.696598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.696598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.696707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.696902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.697084] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acc9d6b8-be91-4755-a23c-2c530ae497fe" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.904582] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('082ce940-517e-4ecd-a42e-d7d185e47139',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.997077] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 in Status: SUCCESS [ 830.997455] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.997586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.997966] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.998102] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.174725] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.408785] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 082ce940-517e-4ecd-a42e-d7d185e47139: rpc.has_security_group_logging(os_id): False [ 831.429335] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.429671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.429671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.429782] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.429886] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.430208] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.430327] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.430453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.430643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.430752] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.430864] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 082ce940-517e-4ecd-a42e-d7d185e47139 is going to be created. [ 831.457944] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 831.458315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.458551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.458863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.459163] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.459323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.459456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.459673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.459794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.460207] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.461889] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 in Status: SUCCESS [ 831.463480] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.463796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.464042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.465243] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.465445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.465619] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.466928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.466928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.467086] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.500561] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.500815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.503316] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.504308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.504438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.504848] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.505043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.517598] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 082ce940-517e-4ecd-a42e-d7d185e47139 in Status: IN_PROGRESS for 2s [ 831.568708] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a in Status: SUCCESS [ 831.569058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.569267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.569520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.569745] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.569907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.569997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.570159] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.570261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.570354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.570448] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e0a8011-b557-40dd-b9b5-481c08d0040a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.677745] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.678018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.678155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.678473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.678612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.678724] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be created. [ 831.703846] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.703957] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.704056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.704587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.704587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.715178] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: UNINITIALIZED for 2s [ 831.931719] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b07f4606-a04e-468f-8194-7420bcbd987d in Status: SUCCESS [ 831.931719] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b07f4606-a04e-468f-8194-7420bcbd987d deletion is rescheduled due to dependency. [ 831.931719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.972170] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.972806] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.072720] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e0a8011-b557-40dd-b9b5-481c08d0040a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.072885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.072959] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.073212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.073379] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.073482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.073546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.073701] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.073794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.073884] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.074056] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e0a8011-b557-40dd-b9b5-481c08d0040a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.074147] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.074202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.074345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.074485] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.074582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.074638] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.074768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.074844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.074926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.075028] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e0a8011-b557-40dd-b9b5-481c08d0040a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.476107] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.476755] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.579601] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e0a8011-b557-40dd-b9b5-481c08d0040a: rpc.has_security_group_logging(os_id): False [ 832.595823] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.596117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.596117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.596325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.596401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.596624] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.596737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.596888] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.596967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.597056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.597265] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.597361] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.597428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.597564] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.597641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.597849] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.597941] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.597995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.598146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.598233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.598323] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a is going to be created. [ 832.660020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.660240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.660240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.660456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.660766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.675680] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a in Status: IN_PROGRESS for 2s [ 832.978932] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.979436] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.979500] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.979753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.979860] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.980011] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 832.981467] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.981588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.981661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.981846] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.981932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.982149] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 is going to be updated. [ 833.122927] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.123271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.123327] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.123581] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.123787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.130021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.130021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.130021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.134341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.134420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.148385] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 833.149400] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 in Status: IN_PROGRESS for 2s [ 833.371825] env[65102]: INFO networking_nsxv3.common.synchronization [req-75ea15bf-f8fd-4f0f-9a2f-3c650ce2368d req-9a357af4-c8bb-435c-9a51-40496033f622 tempest-ListServerFiltersTestJSON-1901090165 tempest-ListServerFiltersTestJSON-1901090165-project-member] Enqueued Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 833.371825] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 833.371825] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.372478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.372711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.373127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.373433] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.373695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.373878] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.374199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.374448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.374679] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.533884] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 082ce940-517e-4ecd-a42e-d7d185e47139 in Status: SUCCESS [ 833.533962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.643045] env[65102]: INFO networking_nsxv3.common.synchronization [req-bdab4f60-f47c-44a6-95af-248a830a47c8 req-0cc4a9da-598d-41b5-9322-605529472a50 tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 833.645160] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 833.645160] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.645739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.645957] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.648639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.648639] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.648639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.648639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.648639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.648639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.648639] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.726541] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 833.726793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.727015] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.727280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.727527] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.727710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.727756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.727965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.728078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.728171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.728264] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.837098] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.837296] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-120" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.837417] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-120" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.837737] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-120" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.838014] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.838188] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.838306] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.838522] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.838667] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.838872] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.839043] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.839190] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.839315] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.839431] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.839537] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.839857] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.859059] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.859204] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 833.859314] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.859504] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-120" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.859824] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-860d5e06-e063-471a-8b43-cda8c6bd94b8 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.859995] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-860d5e06-e063-471a-8b43-cda8c6bd94b8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.860164] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-860d5e06-e063-471a-8b43-cda8c6bd94b8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.860470] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-860d5e06-e063-471a-8b43-cda8c6bd94b8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.860608] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('860d5e06-e063-471a-8b43-cda8c6bd94b8',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.879079] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.879343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.879641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.879725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.879761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.880037] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.880159] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.880224] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.880384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.880462] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.880551] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1966cd49-8e43-4ab8-862a-7f66af79660a already deleted. [ 833.880634] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.149603] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.149954] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.150032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.150277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.150443] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.150749] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.150920] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.151061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.151316] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.151605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.151605] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 834.190349] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.190349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.190349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.190349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.190349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.200473] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 834.231273] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.231273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.231480] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.231575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.231747] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.231844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.231907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.232850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.232850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.232850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.232850] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.232850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.232850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.232850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.233389] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.233389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.233389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.233389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.233389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.233389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.233753] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.364036] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.364324] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.364396] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.364700] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.364851] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.365017] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 860d5e06-e063-471a-8b43-cda8c6bd94b8 not found, creating... [ 834.365297] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.365457] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.365570] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.366107] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.366107] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.366295] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.366518] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.366606] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.366873] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.367050] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.367203] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 860d5e06-e063-471a-8b43-cda8c6bd94b8 is going to be created. [ 834.392956] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.393215] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.393349] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.393717] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.394109] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.394386] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-860d5e06-e063-471a-8b43-cda8c6bd94b8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.688759] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a in Status: SUCCESS [ 834.689055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.736352] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad: rpc.has_security_group_logging(os_id): False [ 834.753214] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.753324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.753324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.753665] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.753752] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.753928] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.754045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.754112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.754284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.754364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.754541] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.754635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.754698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.754837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.754912] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.755113] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.755208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.755268] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.755408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.755484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.755568] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be created. [ 834.774537] env[65102]: INFO networking_nsxv3.common.synchronization [req-39fc1e09-50b6-471b-acb8-0d43fe57cb6c req-00acbd6c-16e0-4fd4-911b-7be0f2079c12 tempest-ServerTagsTestJSON-1705843489 tempest-ServerTagsTestJSON-1705843489-project-member] Enqueued Resource ID: c9efb249-50ca-405f-918d-507bd86040c4 with Priority: HIGHEST for action security_group_members [ 834.775362] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9efb249-50ca-405f-918d-507bd86040c4 with Priority: HIGHEST for action security_group_members [ 834.775741] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9efb249-50ca-405f-918d-507bd86040c4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.775872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.776157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.776157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.776304] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.776400] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.776458] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.776599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.776682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.776776] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9efb249-50ca-405f-918d-507bd86040c4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.821868] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.822061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.822117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.822305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.822491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.834595] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 835.140885] env[65102]: INFO networking_nsxv3.common.synchronization [req-75ea15bf-f8fd-4f0f-9a2f-3c650ce2368d req-59b3d422-72ed-4063-8d8d-aa00921e2faf service nova] Enqueued Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_rules [ 835.141146] env[65102]: INFO networking_nsxv3.common.synchronization [req-75ea15bf-f8fd-4f0f-9a2f-3c650ce2368d req-59b3d422-72ed-4063-8d8d-aa00921e2faf service nova] Enqueued Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 835.141301] env[65102]: INFO networking_nsxv3.common.synchronization [req-75ea15bf-f8fd-4f0f-9a2f-3c650ce2368d req-59b3d422-72ed-4063-8d8d-aa00921e2faf service nova] Enqueued Resource ID: 860d5e06-e063-471a-8b43-cda8c6bd94b8 with Priority: HIGHEST for action port [ 835.141751] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_rules [ 835.141889] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 835.141985] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 860d5e06-e063-471a-8b43-cda8c6bd94b8 with Priority: HIGHEST for action port [ 835.142270] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.142398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.142493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.142792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.142902] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.143831] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.144202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.144279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.144461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.144614] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.144710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.144824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.144907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.144989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.145311] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.146091] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-860d5e06-e063-471a-8b43-cda8c6bd94b8 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.146199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-860d5e06-e063-471a-8b43-cda8c6bd94b8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.146261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-860d5e06-e063-471a-8b43-cda8c6bd94b8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.146680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-860d5e06-e063-471a-8b43-cda8c6bd94b8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.146680] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('860d5e06-e063-471a-8b43-cda8c6bd94b8',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.157981] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 in Status: SUCCESS [ 835.158256] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.158920] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 835.159143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.159291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.159486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.159672] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.159836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.159836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.160145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.160389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.160490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.160584] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.162202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.166242] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.166242] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.166242] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.166242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.166242] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.280421] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.281180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.281180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.281180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.281180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.281424] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.281424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.281424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.281556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.281598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.281707] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9efb249-50ca-405f-918d-507bd86040c4 is going to be updated. [ 835.327605] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.327779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.327855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.328139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.328303] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.338134] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9efb249-50ca-405f-918d-507bd86040c4 in Status: IN_PROGRESS for 2s [ 835.648471] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.648647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.648917] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.650106] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 860d5e06-e063-471a-8b43-cda8c6bd94b8 with status ACTIVE [ 835.650380] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.650532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.650633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.650881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.651052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.651319] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.651490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.651608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.651784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.651932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.652178] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.652296] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.652362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.652516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.652591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.652681] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 860d5e06-e063-471a-8b43-cda8c6bd94b8 is going to be updated. [ 835.667746] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.668837] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for daef1b5a-f25a-405c-9f5a-58444ec5510f: rpc.has_security_group_logging(os_id): False [ 835.680920] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.681172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.681231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.681419] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.682075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.682075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-860d5e06-e063-471a-8b43-cda8c6bd94b8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.693072] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.693072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.693072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.693072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.713457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.714261] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.714261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.714261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.714261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.714520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.714520] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.714605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.714643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.714787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.714875] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.715018] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.715152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.715222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.715356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.715428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.715506] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 835.783488] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.783685] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.783685] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.784053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.784669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.810744] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 836.111900] env[65102]: INFO networking_nsxv3.common.synchronization [req-3945bb84-d318-45c4-93a2-c2584a75416d req-99643236-aae5-4443-bc1f-0722d5d82106 tempest-ListServerFiltersTestJSON-1901090165 tempest-ListServerFiltersTestJSON-1901090165-project-member] Enqueued Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 836.112707] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 836.113545] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.113545] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.154671] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.171442] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14: rpc.has_security_group_logging(os_id): False [ 836.191072] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.191284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.191284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.191437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.191841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.191841] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.191841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.192188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.192188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.192188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.192348] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 is going to be updated. [ 836.212493] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 4s [ 836.261262] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.261349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.261428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.261668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.261854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.276273] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 in Status: IN_PROGRESS for 2s [ 836.528263] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.528263] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-120" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.529316] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-120" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.529734] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-120" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.529965] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.530197] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.530339] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.531327] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.531327] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.532619] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.532619] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.532619] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.532619] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.532619] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 836.532619] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.533139] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.554089] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.554245] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 836.555493] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.555795] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-120" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.556240] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.556351] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.556437] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.556749] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.556911] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.658947] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.659056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.659115] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.659368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.659463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.659601] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1966cd49-8e43-4ab8-862a-7f66af79660a is going to be created. [ 836.686360] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.686360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.686475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.686660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.686893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.698286] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: UNINITIALIZED for 2s [ 836.850829] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 836.850936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.954766] env[65102]: INFO networking_nsxv3.common.synchronization [req-bd357d47-42f2-4989-bf64-d8e269623652 req-84b18128-8d0d-41fb-8c2e-5b7ab18f2a5e tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: 85b46990-bd7b-4abe-881c-9016519cf955 with Priority: HIGHEST for action security_group_members [ 836.955301] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85b46990-bd7b-4abe-881c-9016519cf955 with Priority: HIGHEST for action security_group_members [ 836.955609] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-85b46990-bd7b-4abe-881c-9016519cf955 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.955730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.955809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.956121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.956313] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.956421] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.956532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.956644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.956729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.956824] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85b46990-bd7b-4abe-881c-9016519cf955',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.060455] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.060746] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.060867] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.061208] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.061379] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.061543] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7 not found, creating... [ 837.061808] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.061970] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.062103] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.062333] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.062471] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.062752] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.062906] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.063033] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.063244] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.063378] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.063518] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7 is going to be created. [ 837.083905] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.084134] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.084792] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.084792] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.084792] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.085070] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.353216] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9efb249-50ca-405f-918d-507bd86040c4 in Status: SUCCESS [ 837.353216] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9efb249-50ca-405f-918d-507bd86040c4 deletion is rescheduled due to dependency. [ 837.353216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.461208] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.461208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.461208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.461208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.494026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.494026] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.494026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.494026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.494271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.494271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.494342] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85b46990-bd7b-4abe-881c-9016519cf955 is going to be updated. [ 837.539347] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.539549] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.539631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.539937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.540129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.551769] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85b46990-bd7b-4abe-881c-9016519cf955 in Status: IN_PROGRESS for 2s [ 837.819191] env[65102]: INFO networking_nsxv3.common.synchronization [req-3945bb84-d318-45c4-93a2-c2584a75416d req-e855a719-3c31-4d53-88c3-da25557f0a68 service nova] Enqueued Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_rules [ 837.819191] env[65102]: INFO networking_nsxv3.common.synchronization [req-3945bb84-d318-45c4-93a2-c2584a75416d req-e855a719-3c31-4d53-88c3-da25557f0a68 service nova] Enqueued Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 837.819191] env[65102]: INFO networking_nsxv3.common.synchronization [req-3945bb84-d318-45c4-93a2-c2584a75416d req-e855a719-3c31-4d53-88c3-da25557f0a68 service nova] Enqueued Resource ID: c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7 with Priority: HIGHEST for action port [ 837.819682] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_rules [ 837.819864] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 837.819920] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7 with Priority: HIGHEST for action port [ 837.820498] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.820565] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.820798] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.820953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.821240] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.821383] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.821598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.821878] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.822063] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.827020] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 837.827020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.827020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.827020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.827020] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.224976] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 838.225245] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f deletion is rescheduled due to dependency. [ 838.225391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.294407] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 in Status: SUCCESS [ 838.294784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.324144] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7 with status ACTIVE [ 838.324349] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.324902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.324902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.325207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.325372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.325665] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.326189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.326189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.326189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.326313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.327171] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.327171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.327171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.327171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.327171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.327171] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7 is going to be updated. [ 838.328985] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.328985] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.328985] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.328985] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.328985] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.329577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.329577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.329577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.329577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.329577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.329577] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.357053] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.357053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.357053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.357053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.357053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.357053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9e1f243-9bcf-4a3a-8b83-1f0496d6a0b7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.708142] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: SUCCESS [ 838.708359] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.708579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.708800] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.709044] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.709118] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.709161] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.709398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.709481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.709564] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.709661] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.710565] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.710733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.710933] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.711052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.711117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.711260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.711339] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.711427] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.772563] env[65102]: INFO networking_nsxv3.common.synchronization [req-ccea7e96-56e0-478a-892c-e6a6cb0a7f34 req-0e7993bd-c425-4bad-adc2-b716bc9ea2a2 tempest-ListServerFiltersTestJSON-1901090165 tempest-ListServerFiltersTestJSON-1901090165-project-member] Enqueued Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 838.773750] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 838.774240] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.774861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.833976] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.833976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.833976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.834248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.834344] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.834449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.834513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.834666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.834753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.834841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.835017] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.835109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.835175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.835314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.835456] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.835546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.835604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.835741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.835827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.835909] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.835999] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.136082] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.136331] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-120" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.136421] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-120" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.136724] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-120" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.136941] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.137111] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.137241] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.137474] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.137635] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.137847] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.137958] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.138853] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.138853] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.138853] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.138853] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.138853] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.161937] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.162128] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 839.162268] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.162467] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-120" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.162911] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-0a1d113a-256a-4a98-a5c6-45d4fe610599 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.163118] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-0a1d113a-256a-4a98-a5c6-45d4fe610599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.163238] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-0a1d113a-256a-4a98-a5c6-45d4fe610599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.163563] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-0a1d113a-256a-4a98-a5c6-45d4fe610599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.163696] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a1d113a-256a-4a98-a5c6-45d4fe610599',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.212849] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.212993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.213192] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.340170] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for daef1b5a-f25a-405c-9f5a-58444ec5510f: rpc.has_security_group_logging(os_id): False [ 839.359060] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.359489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.359489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.359609] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.359712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.359969] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.360096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.360186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.360393] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.360478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.360749] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.360817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.360817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.360957] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.361044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.361563] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.361676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.361743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.361919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.362013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.362151] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 839.432025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.432207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.432254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.432471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.432622] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.444863] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 839.561874] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85b46990-bd7b-4abe-881c-9016519cf955 in Status: SUCCESS [ 839.562079] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85b46990-bd7b-4abe-881c-9016519cf955 deletion is rescheduled due to dependency. [ 839.562203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.666615] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.666840] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.666965] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.667275] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.667420] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.667572] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 0a1d113a-256a-4a98-a5c6-45d4fe610599 not found, creating... [ 839.667822] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.667974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.668100] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.668318] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.668452] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.668725] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.668876] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.668988] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.669207] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.669409] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.669550] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 0a1d113a-256a-4a98-a5c6-45d4fe610599 is going to be created. [ 839.691262] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.691481] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.691608] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.691887] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.692137] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.692352] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-0a1d113a-256a-4a98-a5c6-45d4fe610599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.715058] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.218376] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.220580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.220580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.220580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.220580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.220580] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1966cd49-8e43-4ab8-862a-7f66af79660a is going to be updated. [ 840.250587] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.252854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.252854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.252854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.252854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.263065] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: IN_PROGRESS for 2s [ 840.440748] env[65102]: INFO networking_nsxv3.common.synchronization [req-ccea7e96-56e0-478a-892c-e6a6cb0a7f34 req-155c7f18-c562-4bfb-a6b3-6d19aceb2a00 service nova] Enqueued Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_rules [ 840.441044] env[65102]: INFO networking_nsxv3.common.synchronization [req-ccea7e96-56e0-478a-892c-e6a6cb0a7f34 req-155c7f18-c562-4bfb-a6b3-6d19aceb2a00 service nova] Enqueued Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 840.441044] env[65102]: INFO networking_nsxv3.common.synchronization [req-ccea7e96-56e0-478a-892c-e6a6cb0a7f34 req-155c7f18-c562-4bfb-a6b3-6d19aceb2a00 service nova] Enqueued Resource ID: 0a1d113a-256a-4a98-a5c6-45d4fe610599 with Priority: HIGHEST for action port [ 840.441623] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_rules [ 840.441765] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 840.441862] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a1d113a-256a-4a98-a5c6-45d4fe610599 with Priority: HIGHEST for action port [ 840.442276] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.442363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.442591] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.442749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.442956] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a1d113a-256a-4a98-a5c6-45d4fe610599 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.443074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a1d113a-256a-4a98-a5c6-45d4fe610599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.443127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a1d113a-256a-4a98-a5c6-45d4fe610599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.443336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a1d113a-256a-4a98-a5c6-45d4fe610599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.443414] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a1d113a-256a-4a98-a5c6-45d4fe610599',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.946484] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a1d113a-256a-4a98-a5c6-45d4fe610599 with status ACTIVE [ 840.946868] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.947127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.947284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.947640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.947776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.948096] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.948302] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.948443] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.948642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.948726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.948991] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.949241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.949326] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.949540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.949628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.949747] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a1d113a-256a-4a98-a5c6-45d4fe610599 is going to be updated. [ 840.980066] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.980066] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.980066] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.980066] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.980066] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.980473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a1d113a-256a-4a98-a5c6-45d4fe610599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.458837] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 841.459106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.273791] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: SUCCESS [ 842.273875] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.275254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.275254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.275254] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.275254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.275254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.275254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.275254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.275254] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.520043] env[65102]: INFO networking_nsxv3.common.synchronization [req-2544a4f8-5b4c-41d1-8f66-17f22d8aa8b1 req-eeb2a960-00c5-4d66-8d9e-5a7742474ee1 tempest-DeleteServersTestJSON-1773899535 tempest-DeleteServersTestJSON-1773899535-project-member] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 842.520679] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 842.521077] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.521265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.521420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.521691] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.521905] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.522077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.522280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.522399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.522530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.522670] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.778329] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.897654] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.897847] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.897991] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.898303] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.898584] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.898758] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.898887] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.899121] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.899281] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.899543] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.899658] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.899785] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.899895] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.900012] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.900165] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.900326] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.920524] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.920739] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 842.920871] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.921785] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.922349] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-8bb68bf5-be11-4086-a291-e8d4eeb2047b taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.922678] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-8bb68bf5-be11-4086-a291-e8d4eeb2047b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.922919] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-8bb68bf5-be11-4086-a291-e8d4eeb2047b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.923912] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-8bb68bf5-be11-4086-a291-e8d4eeb2047b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.924103] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb68bf5-be11-4086-a291-e8d4eeb2047b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.025164] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.025413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.025554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.025867] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.026028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.026344] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.026492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.026611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.026908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.027046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.027171] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be deleted. [ 843.060038] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.060219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.060297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.060598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.060858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.060932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.283387] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.428734] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.429154] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.429450] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.429888] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.430175] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.430436] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 8bb68bf5-be11-4086-a291-e8d4eeb2047b not found, creating... [ 843.430928] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.431264] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.431492] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.431914] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.432179] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.432731] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.433013] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.433266] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.433645] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.433895] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.434196] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 8bb68bf5-be11-4086-a291-e8d4eeb2047b is going to be created. [ 843.462080] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.462205] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.462268] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.462507] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.462817] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.463067] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-8bb68bf5-be11-4086-a291-e8d4eeb2047b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.787035] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.787343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.787343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.787603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.787700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.787804] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1966cd49-8e43-4ab8-862a-7f66af79660a is going to be updated. [ 843.823157] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.823335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.823409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.823643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.823807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.838323] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: IN_PROGRESS for 2s [ 844.010547] env[65102]: INFO networking_nsxv3.common.synchronization [req-2dbb7c12-0b61-4a93-af22-bfe10b006901 req-02dfe718-18cd-4a88-bb60-683698340b29 tempest-VolumesAdminNegativeTest-870844795 tempest-VolumesAdminNegativeTest-870844795-project-member] Enqueued Resource ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a with Priority: HIGHEST for action security_group_members [ 844.012202] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a with Priority: HIGHEST for action security_group_members [ 844.012202] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e0a8011-b557-40dd-b9b5-481c08d0040a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.012202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.012202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.012202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.012202] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.012202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.012501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.012501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.012832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.012832] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e0a8011-b557-40dd-b9b5-481c08d0040a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.283855] env[65102]: INFO networking_nsxv3.common.synchronization [req-2544a4f8-5b4c-41d1-8f66-17f22d8aa8b1 req-b75cdd47-554a-4834-a846-f616389c23ef service nova] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_rules [ 844.283855] env[65102]: INFO networking_nsxv3.common.synchronization [req-2544a4f8-5b4c-41d1-8f66-17f22d8aa8b1 req-b75cdd47-554a-4834-a846-f616389c23ef service nova] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 844.283855] env[65102]: INFO networking_nsxv3.common.synchronization [req-2544a4f8-5b4c-41d1-8f66-17f22d8aa8b1 req-b75cdd47-554a-4834-a846-f616389c23ef service nova] Enqueued Resource ID: 8bb68bf5-be11-4086-a291-e8d4eeb2047b with Priority: HIGHEST for action port [ 844.284397] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_rules [ 844.284699] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 844.284810] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bb68bf5-be11-4086-a291-e8d4eeb2047b with Priority: HIGHEST for action port [ 844.285142] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.285266] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.285349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.285667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.285667] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.286767] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.286767] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.286937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.287137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.287302] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.287411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.287499] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.288970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.288970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.288970] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.288970] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bb68bf5-be11-4086-a291-e8d4eeb2047b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.288970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bb68bf5-be11-4086-a291-e8d4eeb2047b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.289604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bb68bf5-be11-4086-a291-e8d4eeb2047b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.289604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bb68bf5-be11-4086-a291-e8d4eeb2047b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.289604] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb68bf5-be11-4086-a291-e8d4eeb2047b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.516055] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.516206] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.516266] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.517262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.517262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.517262] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.517262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.517262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.517262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.517262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.517877] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a is going to be updated. [ 844.559509] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.559652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.559726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.559963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.560165] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.571721] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a in Status: IN_PROGRESS for 2s [ 844.793148] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.793148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.793148] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.793148] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bb68bf5-be11-4086-a291-e8d4eeb2047b with status ACTIVE [ 844.793148] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.793148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.793148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.793148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.793148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.793148] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.793148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.796492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.796492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.796492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.796492] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.796492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.796492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.796492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.796492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.796492] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bb68bf5-be11-4086-a291-e8d4eeb2047b is going to be updated. [ 844.817269] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.817505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.817580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.817801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.818055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.818329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bb68bf5-be11-4086-a291-e8d4eeb2047b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.297841] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.801149] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.801494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.801494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.801583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.801583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.801736] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be created. [ 845.829169] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.829334] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.829401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.829754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.830068] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.842434] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: UNINITIALIZED for 2s [ 845.850297] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: SUCCESS [ 845.850297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.850297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.850297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.850470] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.850629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.850629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.851054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.851054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.851054] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.353079] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.586381] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a in Status: SUCCESS [ 846.586565] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e0a8011-b557-40dd-b9b5-481c08d0040a deletion is rescheduled due to dependency. [ 846.586679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e0a8011-b557-40dd-b9b5-481c08d0040a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.855983] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.185370] env[65102]: INFO networking_nsxv3.common.synchronization [req-a5ed87da-277a-43cc-a3bb-344d97c6df5c req-fcafeeb7-86f6-4530-964c-1fdb804685cd tempest-ServersTestBootFromVolume-630499006 tempest-ServersTestBootFromVolume-630499006-project-member] Enqueued Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGHEST for action security_group_members [ 847.188079] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGHEST for action security_group_members [ 847.188079] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-14808516-a2e0-455d-83e1-fa5b5fe0e828 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.188079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.188079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.188079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.188079] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.188079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.188079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.188079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.188079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.188079] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14808516-a2e0-455d-83e1-fa5b5fe0e828',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.360712] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.360712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.360712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.360712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.361168] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.361168] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1966cd49-8e43-4ab8-862a-7f66af79660a is going to be updated. [ 847.401641] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.401976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.401976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.402211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.402858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.418142] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: IN_PROGRESS for 2s [ 847.691467] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.691640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.691716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.692016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.692189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.692381] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.692445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.692513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.692679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.692845] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.692845] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 is going to be updated. [ 847.723666] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.723816] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.723874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.724195] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.724327] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.735439] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 in Status: IN_PROGRESS for 2s [ 847.853484] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 847.853728] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.853928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.854177] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.854441] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.854605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.854696] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.854889] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.854997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.855102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.855246] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.359659] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.359659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.359659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.359659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.360158] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.360158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.360158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.360363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.360363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.360363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.361024] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.361024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.361024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.361024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.361024] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.361424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.361424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.361424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.361424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.361424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.362440] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.863705] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99c8f96e-2cdb-49cd-8847-bf7698ff539f: rpc.has_security_group_logging(os_id): False [ 848.883985] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.884209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.884291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.884602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.884705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.884959] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.885095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.885132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.885292] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.885373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.885561] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.885658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.885742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.885917] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.885995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.887268] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.887268] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.887268] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.887268] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.887268] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.887268] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be created. [ 848.953635] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.953791] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.953892] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.954142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.954334] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.967337] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 849.433036] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: SUCCESS [ 849.433036] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.433036] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.433415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.433415] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.433547] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.433629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.433814] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.433921] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.434055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.434257] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.434352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.434415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.434580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.434744] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.434863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.434926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.435375] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.435461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.435626] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.435747] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.436840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.437070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.437256] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.437375] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.437447] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.437630] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.437726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.437846] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.749546] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 in Status: SUCCESS [ 849.750890] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 deletion is rescheduled due to dependency. [ 849.750890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.939474] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1966cd49-8e43-4ab8-862a-7f66af79660a: rpc.has_security_group_logging(os_id): False [ 849.940807] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.964070] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.964270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.964338] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.964560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.964656] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.964876] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.964971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.965051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.965255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.965335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.965630] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.965721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.965721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.965877] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.965951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.966167] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.966297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.966339] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.966865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.966865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.966865] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1966cd49-8e43-4ab8-862a-7f66af79660a is going to be created. [ 850.032067] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.032268] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.032345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.032567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.033014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.049470] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: IN_PROGRESS for 2s [ 850.446489] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.950149] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.950315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.950377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.950603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.950687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.950803] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1966cd49-8e43-4ab8-862a-7f66af79660a is going to be updated. [ 850.981525] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 850.982397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.985363] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.985628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.985628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.986523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.986523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.995620] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: IN_PROGRESS for 2s [ 852.064270] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: SUCCESS [ 852.064635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.064694] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.064952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.065073] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.187419] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 852.187544] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 852.326294] env[65102]: INFO networking_nsxv3.common.synchronization [None req-587acd35-9e56-4584-b741-83fe2e11e7b2 None None] Enqueued Resource ID: 71f925f1-e392-48d8-b9cf-03eab97415c8 with Priority: HIGHEST for action port [ 852.326294] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71f925f1-e392-48d8-b9cf-03eab97415c8 with Priority: HIGHEST for action port [ 852.326803] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-71f925f1-e392-48d8-b9cf-03eab97415c8 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.326930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71f925f1-e392-48d8-b9cf-03eab97415c8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.327025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71f925f1-e392-48d8-b9cf-03eab97415c8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.327336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71f925f1-e392-48d8-b9cf-03eab97415c8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.327475] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71f925f1-e392-48d8-b9cf-03eab97415c8',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.568132] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.568132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.830885] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71f925f1-e392-48d8-b9cf-03eab97415c8 [ 852.830885] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.830885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.830885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.830885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.831265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.831265] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71f925f1-e392-48d8-b9cf-03eab97415c8 already deleted. [ 852.831265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71f925f1-e392-48d8-b9cf-03eab97415c8" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.007995] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: SUCCESS [ 853.008310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.008526] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.008794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.009035] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.009156] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.009251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.009409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.009500] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.009597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.009695] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.513711] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.514035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.514091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.514325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.514510] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.514617] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.514682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.514852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.516282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.516413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.516598] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.516704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.516772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.517103] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.517270] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.517420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.517458] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.517595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.517700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.517807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.517913] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.020453] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1966cd49-8e43-4ab8-862a-7f66af79660a: rpc.has_security_group_logging(os_id): False [ 854.038875] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.039020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.039086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.039363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.039578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.039782] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.040054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.040143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.040417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.040561] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.040821] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.040967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.041112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.041226] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.041322] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.041524] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.041611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.041668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.041820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.041931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.041996] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1966cd49-8e43-4ab8-862a-7f66af79660a is going to be updated. [ 854.128525] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.128743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.128821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.129158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.129310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.143784] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: IN_PROGRESS for 2s [ 854.824591] env[65102]: INFO networking_nsxv3.common.synchronization [None req-805b65a0-7f04-423b-92ea-2510010b005a None None] Enqueued Resource ID: bfe1b2e2-2c88-4147-9b09-246d8743ef4c with Priority: HIGHEST for action port [ 854.825348] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfe1b2e2-2c88-4147-9b09-246d8743ef4c with Priority: HIGHEST for action port [ 854.825494] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfe1b2e2-2c88-4147-9b09-246d8743ef4c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.826471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfe1b2e2-2c88-4147-9b09-246d8743ef4c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.826471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfe1b2e2-2c88-4147-9b09-246d8743ef4c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.826471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfe1b2e2-2c88-4147-9b09-246d8743ef4c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.826471] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfe1b2e2-2c88-4147-9b09-246d8743ef4c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.329931] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bfe1b2e2-2c88-4147-9b09-246d8743ef4c [ 855.329931] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.329931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.329931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.329931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.329931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.329931] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bfe1b2e2-2c88-4147-9b09-246d8743ef4c already deleted. [ 855.329931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfe1b2e2-2c88-4147-9b09-246d8743ef4c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.159482] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: SUCCESS [ 856.159790] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.160695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.160968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.161218] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.666214] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.666380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.666380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.666598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.666790] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.666906] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.667074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.667679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.667679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.667679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.667679] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.170310] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.170695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.170695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.170829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.170932] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.171057] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.171121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.171270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.171352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.171672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.171672] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.171672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.172931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.172931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.172931] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.172931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.172931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.172931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.172931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.172931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.172931] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.675294] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1966cd49-8e43-4ab8-862a-7f66af79660a: rpc.has_security_group_logging(os_id): False [ 857.697021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.697021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.697021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.697021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.697021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.697021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.697021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.697021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.697704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.697704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.697704] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.697704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.697704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.697704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.698184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.698184] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.698184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.698591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.698768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.698852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.698944] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1966cd49-8e43-4ab8-862a-7f66af79660a is going to be updated. [ 857.768309] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.768493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.768773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.768773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.769891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.787680] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: IN_PROGRESS for 2s [ 858.406024] env[65102]: INFO networking_nsxv3.common.synchronization [None req-58f3d815-1bae-4d7a-805b-2ebeda6a9139 None None] Enqueued Resource ID: d43c1584-7885-46b4-9c30-afd911b3785f with Priority: HIGHEST for action port [ 858.406024] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43c1584-7885-46b4-9c30-afd911b3785f with Priority: HIGHEST for action port [ 858.406024] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d43c1584-7885-46b4-9c30-afd911b3785f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.406024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d43c1584-7885-46b4-9c30-afd911b3785f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.406024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d43c1584-7885-46b4-9c30-afd911b3785f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.406834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d43c1584-7885-46b4-9c30-afd911b3785f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.407112] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d43c1584-7885-46b4-9c30-afd911b3785f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.910027] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d43c1584-7885-46b4-9c30-afd911b3785f [ 858.910395] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.910520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.910637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.910877] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.911015] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.911139] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d43c1584-7885-46b4-9c30-afd911b3785f already deleted. [ 858.911272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d43c1584-7885-46b4-9c30-afd911b3785f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.806806] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: SUCCESS [ 859.807192] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.453927] env[65102]: INFO networking_nsxv3.common.synchronization [None req-7bebc5d4-7808-484e-a9db-cd7f7858e503 tempest-ServersTestFqdnHostnames-624065465 tempest-ServersTestFqdnHostnames-624065465-project-member] Enqueued Resource ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 with Priority: HIGHEST for action security_group_rules [ 860.453927] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 with Priority: HIGHEST for action security_group_rules [ 860.455545] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.457196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.457297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.457645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.457787] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bf5a5e9-3448-461d-8616-ceb9cef4d902',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.560018] env[65102]: INFO networking_nsxv3.common.synchronization [None req-920e3e8d-b7b6-44d5-a3a7-b118a2df40ae None None] Enqueued Resource ID: 52f09ff5-32d3-48d4-bf26-9694a012b8c0 with Priority: HIGHEST for action port [ 860.560629] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f09ff5-32d3-48d4-bf26-9694a012b8c0 with Priority: HIGHEST for action port [ 860.560974] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-52f09ff5-32d3-48d4-bf26-9694a012b8c0 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.561117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52f09ff5-32d3-48d4-bf26-9694a012b8c0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.561199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52f09ff5-32d3-48d4-bf26-9694a012b8c0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.561440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52f09ff5-32d3-48d4-bf26-9694a012b8c0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.561545] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52f09ff5-32d3-48d4-bf26-9694a012b8c0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.645091] env[65102]: INFO networking_nsxv3.common.synchronization [None req-ef7ca71f-4795-4f4b-9d5d-6444e4149a8a tempest-ServersTestFqdnHostnames-624065465 tempest-ServersTestFqdnHostnames-624065465-project-member] Enqueued Resource ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 with Priority: HIGHEST for action security_group_rules [ 860.645950] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 with Priority: HIGHEST for action security_group_rules [ 860.646306] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.646438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.989602] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.989602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.989602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.989602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.989602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.989602] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 already deleted. [ 860.989602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.989602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.989602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.989602] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bf5a5e9-3448-461d-8616-ceb9cef4d902',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.064708] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52f09ff5-32d3-48d4-bf26-9694a012b8c0 [ 861.064708] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.064708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.065255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.065255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.065255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.065255] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52f09ff5-32d3-48d4-bf26-9694a012b8c0 already deleted. [ 861.065255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52f09ff5-32d3-48d4-bf26-9694a012b8c0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.516635] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.517892] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.517892] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.518022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.518100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.518318] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 already deleted. [ 861.518421] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.363024] env[65102]: INFO networking_nsxv3.common.synchronization [req-80d8b61c-4407-46d9-9000-2cd6363bd607 req-d53077db-642f-4dfa-9e9a-fc4b9a65f63f tempest-ServerMetadataTestJSON-1796680905 tempest-ServerMetadataTestJSON-1796680905-project-member] Enqueued Resource ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 with Priority: HIGHEST for action security_group_members [ 863.363024] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 with Priority: HIGHEST for action security_group_members [ 863.363024] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55ab5c0-f0c2-4178-85f4-c461e1efe368 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.363024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.363024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.363024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.363024] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.363578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.363578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.363578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.363578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.363692] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55ab5c0-f0c2-4178-85f4-c461e1efe368',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.754443] env[65102]: INFO networking_nsxv3.common.synchronization [req-9f207b2b-cc9f-4b73-a3d8-e413b1f42f5c req-19ec4b9e-7347-49a6-80f3-4d802c9512dc tempest-ImagesTestJSON-2026451637 tempest-ImagesTestJSON-2026451637-project-member] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 863.754653] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 863.755852] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.756014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.756110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.756333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.756505] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.756605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.756669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.756839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.756926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.757041] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.866926] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.866926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.866926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.867170] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.867170] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.867412] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.867541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.867637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.868224] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.868224] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.868224] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 already deleted. [ 863.868224] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.955943] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.955943] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-48" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.956099] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-48" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.956361] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-48" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.956604] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.956752] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.956878] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.958080] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.958124] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.958386] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 863.958474] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 863.958589] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 863.958694] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 863.958805] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 863.958911] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 863.959053] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 863.982686] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 863.982686] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 863.982686] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 863.982686] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-48" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.982970] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-2f395da6-1303-4770-b9a5-eed2e9141181 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.983188] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-2f395da6-1303-4770-b9a5-eed2e9141181" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.983290] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-2f395da6-1303-4770-b9a5-eed2e9141181" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.983654] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-2f395da6-1303-4770-b9a5-eed2e9141181" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.983806] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f395da6-1303-4770-b9a5-eed2e9141181',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.260024] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.260309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.260447] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.260722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.260853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.261089] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.261216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.261284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.261460] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.261583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.261687] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be updated. [ 864.319507] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.319507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.319507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.319761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.319761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.355526] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 864.486835] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.487292] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.487292] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.487569] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.487775] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.487933] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 2f395da6-1303-4770-b9a5-eed2e9141181 not found, creating... [ 864.488190] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.488372] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.488510] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.488734] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.488884] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.489473] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.490848] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.490848] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.490848] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.490848] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.490848] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 2f395da6-1303-4770-b9a5-eed2e9141181 is going to be created. [ 864.518507] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.518507] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.518507] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.518839] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.518986] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.519234] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-2f395da6-1303-4770-b9a5-eed2e9141181" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.346863] env[65102]: INFO networking_nsxv3.common.synchronization [req-80d8b61c-4407-46d9-9000-2cd6363bd607 req-daa969d5-217e-408e-8146-18f82c87a1b1 service nova] Enqueued Resource ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 with Priority: HIGHEST for action security_group_rules [ 865.346863] env[65102]: INFO networking_nsxv3.common.synchronization [req-80d8b61c-4407-46d9-9000-2cd6363bd607 req-daa969d5-217e-408e-8146-18f82c87a1b1 service nova] Enqueued Resource ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 with Priority: HIGHEST for action security_group_members [ 865.346863] env[65102]: INFO networking_nsxv3.common.synchronization [req-80d8b61c-4407-46d9-9000-2cd6363bd607 req-daa969d5-217e-408e-8146-18f82c87a1b1 service nova] Enqueued Resource ID: 2f395da6-1303-4770-b9a5-eed2e9141181 with Priority: HIGHEST for action port [ 865.346863] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 with Priority: HIGHEST for action security_group_rules [ 865.347065] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 with Priority: HIGHEST for action security_group_members [ 865.347241] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f395da6-1303-4770-b9a5-eed2e9141181 with Priority: HIGHEST for action port [ 865.347665] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b55ab5c0-f0c2-4178-85f4-c461e1efe368 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.347886] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.348210] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.348599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.348820] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b55ab5c0-f0c2-4178-85f4-c461e1efe368',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.349938] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55ab5c0-f0c2-4178-85f4-c461e1efe368 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.350168] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.350273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.350520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.350744] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.350889] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.350984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.351211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.351386] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.351519] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55ab5c0-f0c2-4178-85f4-c461e1efe368',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.353376] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f395da6-1303-4770-b9a5-eed2e9141181 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.353543] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f395da6-1303-4770-b9a5-eed2e9141181" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.353644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f395da6-1303-4770-b9a5-eed2e9141181" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.353846] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f395da6-1303-4770-b9a5-eed2e9141181" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.353981] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f395da6-1303-4770-b9a5-eed2e9141181',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.785561] env[65102]: INFO networking_nsxv3.common.synchronization [req-8a8328e5-4896-4bb6-bb40-c7d5dccf961b req-98022572-2a41-477e-979f-664465f98bb8 tempest-ServersWithSpecificFlavorTestJSON-1123838888 tempest-ServersWithSpecificFlavorTestJSON-1123838888-project-member] Enqueued Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_members [ 865.786178] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a with Priority: HIGHEST for action security_group_members [ 865.786496] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.786619] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.786733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.786972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.787182] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.787405] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.787473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.787635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.787725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.787823] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0bc7ffe-997e-4e93-849d-b293c0ee0e6a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.856508] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f395da6-1303-4770-b9a5-eed2e9141181 with status ACTIVE [ 865.856743] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.856901] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.856942] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.857160] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.857399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.857454] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.857525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.857578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.857729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.857804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.857981] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.858109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.858148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.858273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.858550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.858550] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f395da6-1303-4770-b9a5-eed2e9141181 is going to be updated. [ 865.859642] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b55ab5c0-f0c2-4178-85f4-c461e1efe368',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.865553] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55ab5c0-f0c2-4178-85f4-c461e1efe368 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.865553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.886803] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.887356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.887356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.887356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.887530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.887741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f395da6-1303-4770-b9a5-eed2e9141181" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.989454] env[65102]: INFO networking_nsxv3.common.synchronization [req-2d1603da-3019-4170-aa72-771f9762f4b0 req-b084e476-32b3-4b68-b0f4-51feeacbc681 tempest-ServerRescueNegativeTestJSON-286642771 tempest-ServerRescueNegativeTestJSON-286642771-project-member] Enqueued Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_members [ 865.990729] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_members [ 865.990729] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e683108f-84a0-4d62-934c-58f2999656a4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.990729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.990729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.990729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.990984] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.990984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.991091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.991220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.991308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.991405] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.292074] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.292074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.292074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.292374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.315603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.316468] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.316468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.316468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.316643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.316766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.318567] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a is going to be updated. [ 866.351043] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.351833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.351833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.351833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.351833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.363116] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a in Status: IN_PROGRESS for 2s [ 866.365175] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 866.365258] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad deletion is rescheduled due to dependency. [ 866.365497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.365578] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b55ab5c0-f0c2-4178-85f4-c461e1efe368',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.467487] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-736 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.467695] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-736" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.467794] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-736" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.468142] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-736" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.468404] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.468607] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.468754] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.469047] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.469250] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.469515] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.470237] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.470237] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.470237] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.470237] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.470237] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.470237] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.494324] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.494524] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 866.494687] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.494880] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-736" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.495730] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-d5026810-9268-4f3f-9e44-06ea55e41569 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.495730] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-d5026810-9268-4f3f-9e44-06ea55e41569" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.495730] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-d5026810-9268-4f3f-9e44-06ea55e41569" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.495925] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-d5026810-9268-4f3f-9e44-06ea55e41569" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.496368] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5026810-9268-4f3f-9e44-06ea55e41569',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.497829] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.497931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.497975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.498569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.498569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.499708] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.499708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.499708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.499708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.499708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.499920] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e683108f-84a0-4d62-934c-58f2999656a4 already deleted. [ 866.499920] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.867708] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.868054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.868054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.868653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.868653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.868653] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 is going to be created. [ 866.897946] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.897946] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.898101] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.898239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.898475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.908542] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 in Status: UNINITIALIZED for 2s [ 867.001896] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.002160] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.002293] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.002580] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.002752] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.002982] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port d5026810-9268-4f3f-9e44-06ea55e41569 not found, creating... [ 867.003287] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.003481] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.003601] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.003863] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.004041] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.004369] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.004565] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.004747] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.005403] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.005403] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.005514] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: d5026810-9268-4f3f-9e44-06ea55e41569 is going to be created. [ 867.029326] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.029793] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.029976] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.030404] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.030809] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.031130] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-d5026810-9268-4f3f-9e44-06ea55e41569" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.782469] env[65102]: INFO networking_nsxv3.common.synchronization [req-2d1603da-3019-4170-aa72-771f9762f4b0 req-dac340e8-456d-4762-9593-0f1b48fe098c service nova] Enqueued Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_rules [ 867.782677] env[65102]: INFO networking_nsxv3.common.synchronization [req-2d1603da-3019-4170-aa72-771f9762f4b0 req-dac340e8-456d-4762-9593-0f1b48fe098c service nova] Enqueued Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_members [ 867.782816] env[65102]: INFO networking_nsxv3.common.synchronization [req-2d1603da-3019-4170-aa72-771f9762f4b0 req-dac340e8-456d-4762-9593-0f1b48fe098c service nova] Enqueued Resource ID: d5026810-9268-4f3f-9e44-06ea55e41569 with Priority: HIGHEST for action port [ 867.783449] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_rules [ 867.783603] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_members [ 867.783715] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5026810-9268-4f3f-9e44-06ea55e41569 with Priority: HIGHEST for action port [ 867.784427] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e683108f-84a0-4d62-934c-58f2999656a4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.784427] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.784427] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.784648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.784714] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.785821] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e683108f-84a0-4d62-934c-58f2999656a4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.786067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.786067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.786287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.786406] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.786618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.787787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.788017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.788113] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.788237] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.790505] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5026810-9268-4f3f-9e44-06ea55e41569 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.790505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5026810-9268-4f3f-9e44-06ea55e41569" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.790505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5026810-9268-4f3f-9e44-06ea55e41569" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.790505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5026810-9268-4f3f-9e44-06ea55e41569" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.790505] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5026810-9268-4f3f-9e44-06ea55e41569',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.292142] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e683108f-84a0-4d62-934c-58f2999656a4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.292142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.292542] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.293526] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5026810-9268-4f3f-9e44-06ea55e41569 with status ACTIVE [ 868.293702] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.293858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.293990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.294149] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.294205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.294360] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.294456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.294524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.294668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.294914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.294914] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.295330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.295496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.296070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.296070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.296070] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5026810-9268-4f3f-9e44-06ea55e41569 is going to be updated. [ 868.329608] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.329770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.329858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.330074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.330251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.330424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5026810-9268-4f3f-9e44-06ea55e41569" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.377978] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a in Status: SUCCESS [ 868.378213] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0bc7ffe-997e-4e93-849d-b293c0ee0e6a deletion is rescheduled due to dependency. [ 868.378343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0bc7ffe-997e-4e93-849d-b293c0ee0e6a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.752274] env[65102]: INFO networking_nsxv3.common.synchronization [req-0cddf89a-47a9-4351-a513-1513a15b6ef9 req-7cd6fc58-6832-4d9f-afac-e28e28b127d0 tempest-ServersTestMultiNic-160748370 tempest-ServersTestMultiNic-160748370-project-member] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 868.753843] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 868.753843] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.753843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.753843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.753843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.753843] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.753843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.753843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.754333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.754333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.754333] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.798645] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.919706] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 in Status: SUCCESS [ 868.919706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.919706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.919706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.919706] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.919706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.921012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.921375] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.921549] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.921911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.922525] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b55ab5c0-f0c2-4178-85f4-c461e1efe368',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.128103] env[65102]: INFO networking_nsxv3.common.synchronization [req-0cddf89a-47a9-4351-a513-1513a15b6ef9 req-8c04e1c1-9acb-43ed-b272-37814a5e581d tempest-ServersTestMultiNic-160748370 tempest-ServersTestMultiNic-160748370-project-member] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 869.128744] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 869.129696] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.129858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.257073] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.257388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.257388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.258777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.288155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.288374] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.288495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.288570] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.288802] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.288899] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.288969] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 869.304056] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.304056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.304056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.304056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.304056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.304056] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e683108f-84a0-4d62-934c-58f2999656a4 is going to be created. [ 869.321622] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.321837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.321914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.322622] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.322877] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.333768] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 869.336672] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.337864] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.337986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.338342] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.338605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.348694] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e683108f-84a0-4d62-934c-58f2999656a4 in Status: UNINITIALIZED for 2s [ 869.425933] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55ab5c0-f0c2-4178-85f4-c461e1efe368 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.426365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.426438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.426628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.426825] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.426942] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.427034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.427207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.427339] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.427376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.427531] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55ab5c0-f0c2-4178-85f4-c461e1efe368 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.427638] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.427700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.427869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.427988] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.428094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.428155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.428575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.428673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.428762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.428857] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b55ab5c0-f0c2-4178-85f4-c461e1efe368',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.521400] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-554 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.521784] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-554" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.521901] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-554" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.522346] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-554" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.522724] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.522954] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.523978] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.525176] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.525176] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.525692] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.525850] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.526031] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.526208] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.526351] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.526506] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.526705] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.569120] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.569421] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 869.569625] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.569830] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-554" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.570491] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-33f13ff6-7d02-4931-bda5-04c0658cfd6c taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.570491] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-33f13ff6-7d02-4931-bda5-04c0658cfd6c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.570742] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-33f13ff6-7d02-4931-bda5-04c0658cfd6c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.571068] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-33f13ff6-7d02-4931-bda5-04c0658cfd6c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.571289] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33f13ff6-7d02-4931-bda5-04c0658cfd6c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.867815] env[65102]: INFO networking_nsxv3.common.synchronization [req-5ea49739-44d9-4f33-8139-1d42630e1041 req-26d3fcc9-d1ea-408d-baf1-01d20ed073d7 tempest-ServerActionsV293TestJSON-238779998 tempest-ServerActionsV293TestJSON-238779998-project-member] Enqueued Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGHEST for action security_group_members [ 869.868454] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGHEST for action security_group_members [ 869.868682] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c61af5d-d112-491b-97cd-9e037a2e5189 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.868808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.868873] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.869083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.869238] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.869345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.869396] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.869533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.869613] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.869705] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c61af5d-d112-491b-97cd-9e037a2e5189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.933634] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b55ab5c0-f0c2-4178-85f4-c461e1efe368: rpc.has_security_group_logging(os_id): False [ 869.952343] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.952507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.952592] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.952833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.952936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.953169] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.953514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.953514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.953514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.953653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.953750] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.953846] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.953940] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.954052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.955046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.955046] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.955046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.955046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.955046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.955046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.955046] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 is going to be created. [ 870.061566] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.061749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.061855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.062437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.063550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.074118] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.075241] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.075560] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.075612] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.075774] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.075933] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 33f13ff6-7d02-4931-bda5-04c0658cfd6c not found, creating... [ 870.076232] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.076389] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.076501] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.076832] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.077077] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.077415] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.077653] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.077710] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.078460] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.078550] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.079073] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 33f13ff6-7d02-4931-bda5-04c0658cfd6c is going to be created. [ 870.080539] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 in Status: IN_PROGRESS for 2s [ 870.106575] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.106575] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.106575] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.106575] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.106575] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.106949] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-33f13ff6-7d02-4931-bda5-04c0658cfd6c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.371638] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.372183] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.372183] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.374143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.374143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.374143] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.374143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.374143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.374143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.374143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.374143] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 is going to be updated. [ 870.407201] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.407201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.407201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.407201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.407201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.416812] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 in Status: IN_PROGRESS for 2s [ 870.848855] env[65102]: INFO networking_nsxv3.common.synchronization [req-0cddf89a-47a9-4351-a513-1513a15b6ef9 req-d425118b-7a30-45a4-acd8-81348b2ffd9c service nova] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_rules [ 870.849080] env[65102]: INFO networking_nsxv3.common.synchronization [req-0cddf89a-47a9-4351-a513-1513a15b6ef9 req-d425118b-7a30-45a4-acd8-81348b2ffd9c service nova] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 870.849132] env[65102]: INFO networking_nsxv3.common.synchronization [req-0cddf89a-47a9-4351-a513-1513a15b6ef9 req-d425118b-7a30-45a4-acd8-81348b2ffd9c service nova] Enqueued Resource ID: 33f13ff6-7d02-4931-bda5-04c0658cfd6c with Priority: HIGHEST for action port [ 870.849989] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_rules [ 870.849989] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 870.853636] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33f13ff6-7d02-4931-bda5-04c0658cfd6c with Priority: HIGHEST for action port [ 870.853636] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.854083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.854083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.854168] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.854245] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.855521] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.855521] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.855722] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-33f13ff6-7d02-4931-bda5-04c0658cfd6c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.856587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33f13ff6-7d02-4931-bda5-04c0658cfd6c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.856587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33f13ff6-7d02-4931-bda5-04c0658cfd6c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.856587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33f13ff6-7d02-4931-bda5-04c0658cfd6c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.856587] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33f13ff6-7d02-4931-bda5-04c0658cfd6c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.973059] env[65102]: INFO networking_nsxv3.common.synchronization [req-705dc0c3-d08f-47de-8aa0-1f6fab0207c1 req-87a7ff93-f41e-45b5-9d94-51e723be34db tempest-ServersAdminTestJSON-1629823880 tempest-ServersAdminTestJSON-1629823880-project-member] Enqueued Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 870.973722] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a41d40-0a8b-401c-801a-f31f69ae007f with Priority: HIGHEST for action security_group_members [ 870.978019] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a41d40-0a8b-401c-801a-f31f69ae007f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.978019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.978019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.978019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.978019] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.978019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.978019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.978019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.978019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.978019] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a41d40-0a8b-401c-801a-f31f69ae007f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.345851] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 871.346069] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 deletion is rescheduled due to dependency. [ 871.346121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.346265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.346524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.346735] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.347372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.347372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.347372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.347372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.347372] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.358040] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.358040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.358194] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33f13ff6-7d02-4931-bda5-04c0658cfd6c with status ACTIVE [ 871.358324] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.358389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.358418] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.358641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.358726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.358917] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.359033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.359097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.359259] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.359338] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.359518] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.359612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.359720] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.359809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.359882] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.360252] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33f13ff6-7d02-4931-bda5-04c0658cfd6c is going to be updated. [ 871.362256] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e683108f-84a0-4d62-934c-58f2999656a4 in Status: SUCCESS [ 871.362256] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.362389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.362739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.362739] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.362739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.362855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.362933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.363023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.363705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.363705] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.387176] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.387576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.387576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.387780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.387780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.387952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33f13ff6-7d02-4931-bda5-04c0658cfd6c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.481603] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.481898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.481898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.482263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.482397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.482651] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.482788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.483250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.483250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.483250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.483250] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f is going to be updated. [ 871.537211] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.537382] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.537489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.537683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.537847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.551809] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: IN_PROGRESS for 2s [ 871.628813] env[65102]: INFO networking_nsxv3.common.synchronization [req-86e80378-768c-42c3-aebf-13670865a07a req-498dced5-4c35-44eb-94a2-384bb0d3ffc8 tempest-ServerRescueNegativeTestJSON-286642771 tempest-ServerRescueNegativeTestJSON-286642771-project-member] Enqueued Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_members [ 871.629402] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_members [ 871.630062] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e683108f-84a0-4d62-934c-58f2999656a4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.631138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.631138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.631138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.631138] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.631138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.631138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.631138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.631874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.631874] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.743332] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-362 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.743586] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-362" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.743700] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-362" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.744119] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-362" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.744417] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.744588] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.744705] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.744958] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.745136] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.745406] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.745537] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.745647] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.745752] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.745869] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.745989] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.746132] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.772795] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.772795] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 871.772795] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.773351] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-362" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.773899] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-c2fdc887-a837-4102-9f3a-85fec34ad2b9 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.774329] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-c2fdc887-a837-4102-9f3a-85fec34ad2b9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.774597] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-c2fdc887-a837-4102-9f3a-85fec34ad2b9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.775062] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-c2fdc887-a837-4102-9f3a-85fec34ad2b9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.775454] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2fdc887-a837-4102-9f3a-85fec34ad2b9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.850511] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.866699] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e683108f-84a0-4d62-934c-58f2999656a4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.866950] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.093243] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 in Status: SUCCESS [ 872.093455] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.133475] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.256411] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-736 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.256615] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-736" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.256781] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-736" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.257118] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-736" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.257423] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.257635] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.257781] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.258042] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.258212] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.258452] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 872.258592] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 872.258724] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 872.258875] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 872.259039] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 872.259178] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 872.259336] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 872.279518] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.279713] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.279855] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.280195] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.280512] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.281008] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port c2fdc887-a837-4102-9f3a-85fec34ad2b9 not found, creating... [ 872.281295] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.281458] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.281575] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.281819] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.282153] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.282459] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.282616] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.282732] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.282944] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.283100] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.283236] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: c2fdc887-a837-4102-9f3a-85fec34ad2b9 is going to be created. [ 872.284986] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 872.285149] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 872.285287] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 872.285444] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-736" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.285712] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-4659264c-9645-4cc9-a6aa-4d3299ae4c31 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.285902] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-4659264c-9645-4cc9-a6aa-4d3299ae4c31" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.285982] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-4659264c-9645-4cc9-a6aa-4d3299ae4c31" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.286266] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-4659264c-9645-4cc9-a6aa-4d3299ae4c31" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.286402] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4659264c-9645-4cc9-a6aa-4d3299ae4c31',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.320161] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.320396] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.320535] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.320850] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.321095] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.321385] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-c2fdc887-a837-4102-9f3a-85fec34ad2b9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.353347] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.427067] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 in Status: SUCCESS [ 872.427420] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 deletion is rescheduled due to dependency. [ 872.427480] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.636467] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.788607] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.788855] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.788962] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.789273] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.789510] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.789607] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 4659264c-9645-4cc9-a6aa-4d3299ae4c31 not found, creating... [ 872.789870] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.790024] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.790142] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.790360] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.790501] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.790895] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.791110] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.791172] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.791376] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.791509] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.791692] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 4659264c-9645-4cc9-a6aa-4d3299ae4c31 is going to be created. [ 872.823710] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.823958] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.824079] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.824750] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.824997] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.825300] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-4659264c-9645-4cc9-a6aa-4d3299ae4c31" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.855258] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.856026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.856026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.856026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.856026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.856026] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 872.887888] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.888062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.888174] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.888503] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.888503] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.906317] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 873.026183] env[65102]: INFO networking_nsxv3.common.synchronization [req-0cddf89a-47a9-4351-a513-1513a15b6ef9 req-72293e8f-e577-4194-a410-183d239a369c service nova] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_rules [ 873.026361] env[65102]: INFO networking_nsxv3.common.synchronization [req-0cddf89a-47a9-4351-a513-1513a15b6ef9 req-72293e8f-e577-4194-a410-183d239a369c service nova] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 873.026502] env[65102]: INFO networking_nsxv3.common.synchronization [req-0cddf89a-47a9-4351-a513-1513a15b6ef9 req-72293e8f-e577-4194-a410-183d239a369c service nova] Enqueued Resource ID: c2fdc887-a837-4102-9f3a-85fec34ad2b9 with Priority: HIGHEST for action port [ 873.027045] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_rules [ 873.027186] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 873.027289] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2fdc887-a837-4102-9f3a-85fec34ad2b9 with Priority: HIGHEST for action port [ 873.027573] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.027675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.027877] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.027948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.028420] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2fdc887-a837-4102-9f3a-85fec34ad2b9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.028852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2fdc887-a837-4102-9f3a-85fec34ad2b9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.028948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2fdc887-a837-4102-9f3a-85fec34ad2b9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.029171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2fdc887-a837-4102-9f3a-85fec34ad2b9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.029257] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2fdc887-a837-4102-9f3a-85fec34ad2b9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.139398] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.139557] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.139629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.139843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.139937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.140050] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e683108f-84a0-4d62-934c-58f2999656a4 is going to be updated. [ 873.167989] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.168186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.168297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.168512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.168665] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.179886] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e683108f-84a0-4d62-934c-58f2999656a4 in Status: IN_PROGRESS for 2s [ 873.506009] env[65102]: INFO networking_nsxv3.common.synchronization [req-86e80378-768c-42c3-aebf-13670865a07a req-49fa4c42-b1d9-4c79-a7a8-f97a6a1c9209 service nova] Enqueued Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_rules [ 873.506298] env[65102]: INFO networking_nsxv3.common.synchronization [req-86e80378-768c-42c3-aebf-13670865a07a req-49fa4c42-b1d9-4c79-a7a8-f97a6a1c9209 service nova] Enqueued Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_members [ 873.506347] env[65102]: INFO networking_nsxv3.common.synchronization [req-86e80378-768c-42c3-aebf-13670865a07a req-49fa4c42-b1d9-4c79-a7a8-f97a6a1c9209 service nova] Enqueued Resource ID: 4659264c-9645-4cc9-a6aa-4d3299ae4c31 with Priority: HIGHEST for action port [ 873.506861] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_rules [ 873.507035] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_members [ 873.507506] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4659264c-9645-4cc9-a6aa-4d3299ae4c31 with Priority: HIGHEST for action port [ 873.507506] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e683108f-84a0-4d62-934c-58f2999656a4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.507506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.507736] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e683108f-84a0-4d62-934c-58f2999656a4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.507736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.507900] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-4659264c-9645-4cc9-a6aa-4d3299ae4c31 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.508021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4659264c-9645-4cc9-a6aa-4d3299ae4c31" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.508060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4659264c-9645-4cc9-a6aa-4d3299ae4c31" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.508276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4659264c-9645-4cc9-a6aa-4d3299ae4c31" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.508498] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4659264c-9645-4cc9-a6aa-4d3299ae4c31',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.530691] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2fdc887-a837-4102-9f3a-85fec34ad2b9 with status ACTIVE [ 873.530964] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.531245] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.531318] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.531529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.531620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.531808] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.531909] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.532020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.532129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.532207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.532390] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.532476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.532545] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.532683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.532755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.532839] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2fdc887-a837-4102-9f3a-85fec34ad2b9 is going to be updated. [ 873.561818] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.562637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.562637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.562637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.562637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.562834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2fdc887-a837-4102-9f3a-85fec34ad2b9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.564270] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a41d40-0a8b-401c-801a-f31f69ae007f in Status: SUCCESS [ 873.564377] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a41d40-0a8b-401c-801a-f31f69ae007f deletion is rescheduled due to dependency. [ 873.564494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a41d40-0a8b-401c-801a-f31f69ae007f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.012361] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4659264c-9645-4cc9-a6aa-4d3299ae4c31 with status ACTIVE [ 874.012600] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.012739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.012805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.013044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.013155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.013370] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.013467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.013554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.013716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.013771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.013924] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.014063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.014063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.014228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.014326] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.014363] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4659264c-9645-4cc9-a6aa-4d3299ae4c31 is going to be updated. [ 874.039709] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.040059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.040281] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.040642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.040755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.041048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4659264c-9645-4cc9-a6aa-4d3299ae4c31" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.917421] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 874.917682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.917864] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.918119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.918312] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.918453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.918598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.918928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.918928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.919050] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.190596] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e683108f-84a0-4d62-934c-58f2999656a4 in Status: SUCCESS [ 875.190834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.191071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.191293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.191763] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.191763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.191763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.192042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.192042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.192042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.192186] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e683108f-84a0-4d62-934c-58f2999656a4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.192240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.192298] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.192406] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.192545] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.192640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.192702] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.192837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.192910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.192979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.193074] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.193929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.194137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.194685] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.194685] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.194685] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.194685] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.194849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.194849] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.421295] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.697560] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e683108f-84a0-4d62-934c-58f2999656a4: rpc.has_security_group_logging(os_id): False [ 875.699378] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.720479] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.720707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.720707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.721039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.721195] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.722360] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.722360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.722360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.722360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.722360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.722733] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.722733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.722807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.723178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.723178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.723439] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.723630] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.723686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.723839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.723930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.724061] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e683108f-84a0-4d62-934c-58f2999656a4 is going to be created. [ 875.793412] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.794334] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.794428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.794642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.794849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.812244] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e683108f-84a0-4d62-934c-58f2999656a4 in Status: IN_PROGRESS for 2s [ 875.923674] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.204445] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.301571] env[65102]: INFO networking_nsxv3.common.synchronization [req-acc19233-4939-4a1c-97a5-6c37d8cc9d6a req-4ec6cb4e-cf5e-4847-8f09-2d293634031d tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 with Priority: HIGHEST for action security_group_members [ 876.305030] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 with Priority: HIGHEST for action security_group_members [ 876.305030] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.305030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.305030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.305030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.305030] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.305030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.305030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.305030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.305030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.305030] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('351e6bc8-ffc9-4dca-ac8a-98595980ddc4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.427100] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.427274] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.427441] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.427570] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.427670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.428043] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 876.458021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.458232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.458309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.458683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.458841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.469334] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 876.707126] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.708266] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.708585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.708975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.709249] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.709699] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e683108f-84a0-4d62-934c-58f2999656a4 is going to be updated. [ 876.750198] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.750198] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.750198] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.750198] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.750198] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.765320] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e683108f-84a0-4d62-934c-58f2999656a4 in Status: IN_PROGRESS for 2s [ 876.808573] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.808784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.808867] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.809239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.809341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.809624] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.809737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.809803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.809981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.810098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.810190] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 already deleted. [ 876.810276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.944624] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.944962] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.944962] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.945220] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.945490] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.945700] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.945871] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.946190] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.946190] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.947077] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.947077] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.947077] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.947077] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.947077] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.947077] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.947077] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.967433] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.967620] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 876.967761] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.968227] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.969857] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-875128de-2b86-4f3c-bef3-92733849587c taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.970312] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-875128de-2b86-4f3c-bef3-92733849587c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.970372] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-875128de-2b86-4f3c-bef3-92733849587c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.970690] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-875128de-2b86-4f3c-bef3-92733849587c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.970867] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('875128de-2b86-4f3c-bef3-92733849587c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.473562] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.473805] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.473927] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.474219] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.474367] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.474530] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 875128de-2b86-4f3c-bef3-92733849587c not found, creating... [ 877.474831] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.475072] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.475211] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.475434] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.475572] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.475856] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.476065] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.476189] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.476396] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.476526] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.476663] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 875128de-2b86-4f3c-bef3-92733849587c is going to be created. [ 877.499038] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.499371] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.499564] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.500069] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.500141] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.500327] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-875128de-2b86-4f3c-bef3-92733849587c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.825375] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e683108f-84a0-4d62-934c-58f2999656a4 in Status: SUCCESS [ 877.825498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.826352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.826352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.826352] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.246592] env[65102]: INFO networking_nsxv3.common.synchronization [req-acc19233-4939-4a1c-97a5-6c37d8cc9d6a req-462337a4-5955-4f87-ab9a-5abc8ff5fce8 service nova] Enqueued Resource ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 with Priority: HIGHEST for action security_group_rules [ 878.246864] env[65102]: INFO networking_nsxv3.common.synchronization [req-acc19233-4939-4a1c-97a5-6c37d8cc9d6a req-462337a4-5955-4f87-ab9a-5abc8ff5fce8 service nova] Enqueued Resource ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 with Priority: HIGHEST for action security_group_members [ 878.247112] env[65102]: INFO networking_nsxv3.common.synchronization [req-acc19233-4939-4a1c-97a5-6c37d8cc9d6a req-462337a4-5955-4f87-ab9a-5abc8ff5fce8 service nova] Enqueued Resource ID: 875128de-2b86-4f3c-bef3-92733849587c with Priority: HIGHEST for action port [ 878.247735] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 with Priority: HIGHEST for action security_group_rules [ 878.247887] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 with Priority: HIGHEST for action security_group_members [ 878.247987] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 875128de-2b86-4f3c-bef3-92733849587c with Priority: HIGHEST for action port [ 878.248314] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.248463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.248577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.248733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.248812] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('351e6bc8-ffc9-4dca-ac8a-98595980ddc4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.249811] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.249894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.249929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.250225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.250411] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.250508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.250543] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.250835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.250925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.251030] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('351e6bc8-ffc9-4dca-ac8a-98595980ddc4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.252144] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-875128de-2b86-4f3c-bef3-92733849587c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.252272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-875128de-2b86-4f3c-bef3-92733849587c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.252347] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-875128de-2b86-4f3c-bef3-92733849587c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.252612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-875128de-2b86-4f3c-bef3-92733849587c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.252688] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('875128de-2b86-4f3c-bef3-92733849587c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.327977] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e683108f-84a0-4d62-934c-58f2999656a4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.328212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.354935] env[65102]: INFO networking_nsxv3.common.synchronization [req-214808c0-3192-4f90-bcaf-fc467a618279 req-41a9a77f-7d71-42e9-8863-d0ef8bf97d82 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 878.355500] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 878.355813] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.355937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.356222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.356283] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.356390] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.356493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.356556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.356700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.356788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.356880] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.480155] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 878.480394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.480577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.480789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.480982] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.481139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.481209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.481377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.481460] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.481548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.481650] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.483198] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.483469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.484049] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.484049] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.485099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.485099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.485099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.485099] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.754315] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.754538] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.754787] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('351e6bc8-ffc9-4dca-ac8a-98595980ddc4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.755809] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 875128de-2b86-4f3c-bef3-92733849587c with status ACTIVE [ 878.756391] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.756594] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.756726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.756989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.757467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.757748] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.757916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.758043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.758287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.758765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.759055] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.759260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.759385] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.759627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.759949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.760111] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 875128de-2b86-4f3c-bef3-92733849587c is going to be updated. [ 878.776456] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e683108f-84a0-4d62-934c-58f2999656a4 in Status: SUCCESS [ 878.776695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.776869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.777107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.777336] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.777826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.777963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.778198] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.778343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.778478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.778639] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.786264] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.786437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.786541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.786720] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.786861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.787037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-875128de-2b86-4f3c-bef3-92733849587c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.859640] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.988773] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.988948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.989166] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.017553] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-16 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.017787] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-16" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.017924] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-16" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.018391] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-16" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.018739] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.018924] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.019108] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.019391] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.019562] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.019846] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.019977] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.020119] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.020393] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.020393] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.020496] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.021014] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.048074] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.048332] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 879.048458] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.048668] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-16" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.049198] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-190c1749-3fb8-4199-b8e7-1ab227d2b30f taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.049421] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.049565] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.050062] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.050226] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('190c1749-3fb8-4199-b8e7-1ab227d2b30f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.262674] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('351e6bc8-ffc9-4dca-ac8a-98595980ddc4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.281463] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e683108f-84a0-4d62-934c-58f2999656a4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.281709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.281709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.281954] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.282068] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.282204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.282295] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.282420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.282507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.282585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.282740] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e683108f-84a0-4d62-934c-58f2999656a4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.282834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.282902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.283022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.283167] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.283284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.283355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.283448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.283523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.283596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.283690] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.361778] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.491856] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.552755] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.555576] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.555576] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.555576] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.555576] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.555576] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 190c1749-3fb8-4199-b8e7-1ab227d2b30f not found, creating... [ 879.555576] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.555576] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.555576] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.555576] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.555576] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.555957] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.556263] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.556522] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.557103] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.557103] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.557530] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 190c1749-3fb8-4199-b8e7-1ab227d2b30f is going to be created. [ 879.580954] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.581236] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.581445] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.581880] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.582161] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.582825] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.765879] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.766094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.766140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.766384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.767267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.767267] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 is going to be created. [ 879.787163] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e683108f-84a0-4d62-934c-58f2999656a4: rpc.has_security_group_logging(os_id): False [ 879.803924] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.803924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.803924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.803924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.803924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.810810] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.811019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.811085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.811430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.811617] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.811840] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.811958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.812062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.812236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.812343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.812620] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.812748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.812825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.813055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.813164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.813433] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.813559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.813658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.813881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.814009] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.814141] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e683108f-84a0-4d62-934c-58f2999656a4 is going to be updated. [ 879.817409] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 in Status: UNINITIALIZED for 2s [ 879.864461] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.864461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.864567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.864744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.864854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.864959] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 879.898870] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.899083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.899127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.899451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.899520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.901442] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.902094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.902094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.902094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.902094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.913431] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 879.928316] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e683108f-84a0-4d62-934c-58f2999656a4 in Status: IN_PROGRESS for 2s [ 879.994433] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.994667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.994667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.994792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.994850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.994956] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 880.052551] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.052947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.052947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.053263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.053468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.072469] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 880.220091] env[65102]: INFO networking_nsxv3.common.synchronization [None req-15a56d9e-d6a4-4ab0-a101-e6c2fd4b2311 None None] Enqueued Resource ID: 767e6444-3a44-4464-8e1e-83b33b79756c with Priority: HIGHEST for action port [ 880.221730] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 767e6444-3a44-4464-8e1e-83b33b79756c with Priority: HIGHEST for action port [ 880.222657] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-767e6444-3a44-4464-8e1e-83b33b79756c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.223534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-767e6444-3a44-4464-8e1e-83b33b79756c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.224643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-767e6444-3a44-4464-8e1e-83b33b79756c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.224935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-767e6444-3a44-4464-8e1e-83b33b79756c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.225260] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('767e6444-3a44-4464-8e1e-83b33b79756c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.343406] env[65102]: INFO networking_nsxv3.common.synchronization [req-214808c0-3192-4f90-bcaf-fc467a618279 req-d10c38f5-89b7-4956-9c04-da3842de8607 service nova] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_rules [ 880.343406] env[65102]: INFO networking_nsxv3.common.synchronization [req-214808c0-3192-4f90-bcaf-fc467a618279 req-d10c38f5-89b7-4956-9c04-da3842de8607 service nova] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 880.343406] env[65102]: INFO networking_nsxv3.common.synchronization [req-214808c0-3192-4f90-bcaf-fc467a618279 req-d10c38f5-89b7-4956-9c04-da3842de8607 service nova] Enqueued Resource ID: 190c1749-3fb8-4199-b8e7-1ab227d2b30f with Priority: HIGHEST for action port [ 880.343406] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_rules [ 880.343406] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 880.343406] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190c1749-3fb8-4199-b8e7-1ab227d2b30f with Priority: HIGHEST for action port [ 880.345145] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.346281] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.346281] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.346281] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.346281] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.352074] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.352074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.352074] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-190c1749-3fb8-4199-b8e7-1ab227d2b30f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.352074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.352074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.352074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.352074] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('190c1749-3fb8-4199-b8e7-1ab227d2b30f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.614941] env[65102]: INFO networking_nsxv3.common.synchronization [req-b2e87e5b-e002-4919-8b08-687745093a38 req-a52221d6-5be3-4da7-ad40-631cfe2df123 tempest-MigrationsAdminTest-673773847 tempest-MigrationsAdminTest-673773847-project-member] Enqueued Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_members [ 880.616947] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_members [ 880.617316] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.617748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.617748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.617748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.618033] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.618033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.618033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.618264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.618264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.619246] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.729643] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 767e6444-3a44-4464-8e1e-83b33b79756c [ 880.729968] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.730129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.730199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.730415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.730535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.730635] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:767e6444-3a44-4464-8e1e-83b33b79756c already deleted. [ 880.730720] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-767e6444-3a44-4464-8e1e-83b33b79756c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.855635] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.855749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.864154] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 190c1749-3fb8-4199-b8e7-1ab227d2b30f with status ACTIVE [ 880.864154] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.864154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.864154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.864395] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.864490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.864671] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.864766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.864914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.865523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.865523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.865523] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.865523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.865523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.865523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.865868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.865868] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 190c1749-3fb8-4199-b8e7-1ab227d2b30f is going to be updated. [ 880.890610] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.890794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.890869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.891100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.891306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.891474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.122316] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.150564] env[65102]: INFO networking_nsxv3.common.synchronization [None req-d315bf85-60ed-4e5c-a813-ba213f5ed508 None None] Enqueued Resource ID: 7f5058de-e512-4caf-99f3-ff846e50de79 with Priority: HIGHEST for action port [ 881.151121] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f5058de-e512-4caf-99f3-ff846e50de79 with Priority: HIGHEST for action port [ 881.151475] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f5058de-e512-4caf-99f3-ff846e50de79 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.151603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f5058de-e512-4caf-99f3-ff846e50de79" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.151670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f5058de-e512-4caf-99f3-ff846e50de79" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.151918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f5058de-e512-4caf-99f3-ff846e50de79" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.152591] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f5058de-e512-4caf-99f3-ff846e50de79',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.624612] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.655098] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f5058de-e512-4caf-99f3-ff846e50de79 [ 881.657364] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.657364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.657364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.657364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.657364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.657364] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f5058de-e512-4caf-99f3-ff846e50de79 already deleted. [ 881.657364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f5058de-e512-4caf-99f3-ff846e50de79" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.831065] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 in Status: SUCCESS [ 881.831065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.831065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.831065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.831355] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.831355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.831443] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.831562] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.831643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.831725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.831813] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('351e6bc8-ffc9-4dca-ac8a-98595980ddc4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.926175] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 881.926175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.926175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.926532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.926727] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.926842] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.926906] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.927309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.927403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.927504] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.947183] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e683108f-84a0-4d62-934c-58f2999656a4 in Status: SUCCESS [ 881.947935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.083351] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 882.084536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.084734] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.084959] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.085172] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.085290] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.085358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.085510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.085593] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.085678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.085864] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.085864] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.085864] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.086233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.086522] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.086522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.086522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.086641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.086641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.086806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.086842] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.129038] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.129038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.129038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.129038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.129304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.129304] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 is going to be updated. [ 882.159958] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.160134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.160236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.160558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.161411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.172279] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: IN_PROGRESS for 2s [ 882.292613] env[65102]: INFO networking_nsxv3.common.synchronization [None req-5eecd4e3-a9ae-4ade-bd5e-b56a3fb47cc5 None None] Enqueued Resource ID: a3ecd894-f555-4088-b633-bf2aabc767a7 with Priority: HIGHEST for action port [ 882.294111] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ecd894-f555-4088-b633-bf2aabc767a7 with Priority: HIGHEST for action port [ 882.297470] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3ecd894-f555-4088-b633-bf2aabc767a7 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.297470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3ecd894-f555-4088-b633-bf2aabc767a7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.297470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3ecd894-f555-4088-b633-bf2aabc767a7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.297470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3ecd894-f555-4088-b633-bf2aabc767a7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.297470] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3ecd894-f555-4088-b633-bf2aabc767a7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.333620] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('351e6bc8-ffc9-4dca-ac8a-98595980ddc4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.431752] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.591857] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 220505b1-a182-4b77-b78e-66a35b312ba6: rpc.has_security_group_logging(os_id): False [ 882.619230] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.619741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.619853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.620100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.620156] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.620436] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.620750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.620750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.620870] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.622305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.622305] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.622305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.622305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.622305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.622649] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.622784] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.622875] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.622935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.623521] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.623521] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.623521] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 882.656908] env[65102]: INFO networking_nsxv3.common.synchronization [req-90952b21-aa72-4357-a8d7-dda43eb92bcb req-ed59d388-0169-4787-b1bb-09d5efaf6acd tempest-ServerGroupTestJSON-1803090293 tempest-ServerGroupTestJSON-1803090293-project-member] Enqueued Resource ID: 085dab98-e474-491b-84c3-9542fcfa6775 with Priority: HIGHEST for action security_group_members [ 882.657688] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085dab98-e474-491b-84c3-9542fcfa6775 with Priority: HIGHEST for action security_group_members [ 882.658043] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-085dab98-e474-491b-84c3-9542fcfa6775 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.658180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.658231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.658561] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.659787] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.659787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.659975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.660153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.660338] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.660434] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('085dab98-e474-491b-84c3-9542fcfa6775',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.802867] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3ecd894-f555-4088-b633-bf2aabc767a7 [ 882.806030] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.806030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.806030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.806030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.806030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.806030] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3ecd894-f555-4088-b633-bf2aabc767a7 already deleted. [ 882.806030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3ecd894-f555-4088-b633-bf2aabc767a7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.806030] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.806901] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.807199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.807505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.807848] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.839570] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 351e6bc8-ffc9-4dca-ac8a-98595980ddc4: rpc.has_security_group_logging(os_id): False [ 882.845262] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 882.878592] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.878592] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.878798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.879586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.880129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.880223] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.881114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.881114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.881114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.881114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.881114] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 is going to be created. [ 882.934827] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.974629] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.974629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.974629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.975207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.975207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.998032] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 in Status: IN_PROGRESS for 2s [ 883.164498] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.164614] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.164717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.165434] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.165434] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.165434] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.165434] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.165434] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.165708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.165708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.165708] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085dab98-e474-491b-84c3-9542fcfa6775 already deleted. [ 883.165784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.438417] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.438803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.438928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.439854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.441699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.441699] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 883.471980] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.471980] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.471980] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.471980] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.471980] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.487311] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 883.742295] env[65102]: INFO networking_nsxv3.common.synchronization [None req-2535a89c-64c1-43ad-bde5-1eaba20e6a61 None None] Enqueued Resource ID: 6df412e8-93f7-41ee-b377-6f876ac50fe3 with Priority: HIGHEST for action port [ 883.742935] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df412e8-93f7-41ee-b377-6f876ac50fe3 with Priority: HIGHEST for action port [ 883.743278] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-6df412e8-93f7-41ee-b377-6f876ac50fe3 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.743399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6df412e8-93f7-41ee-b377-6f876ac50fe3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.743461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6df412e8-93f7-41ee-b377-6f876ac50fe3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.744321] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6df412e8-93f7-41ee-b377-6f876ac50fe3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.744536] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df412e8-93f7-41ee-b377-6f876ac50fe3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.767058] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-194 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.767219] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-194" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.767301] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-194" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.767698] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-194" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.767990] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.768165] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.768281] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.768504] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.768649] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.768858] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.768994] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.769127] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.769235] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.769346] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.769458] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.769589] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.790352] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.790515] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 883.790649] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.790826] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-194" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.791273] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-c23ac068-c418-45e9-8edc-0e541664cbef taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.791470] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-c23ac068-c418-45e9-8edc-0e541664cbef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.791871] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-c23ac068-c418-45e9-8edc-0e541664cbef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.791933] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-c23ac068-c418-45e9-8edc-0e541664cbef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.792052] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c23ac068-c418-45e9-8edc-0e541664cbef',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.185612] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: SUCCESS [ 884.185612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.247386] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6df412e8-93f7-41ee-b377-6f876ac50fe3 [ 884.247520] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.247596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.247639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.247837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.247943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.248153] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6df412e8-93f7-41ee-b377-6f876ac50fe3 already deleted. [ 884.248153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6df412e8-93f7-41ee-b377-6f876ac50fe3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.294769] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.295055] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.295199] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.295494] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.295667] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.296194] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port c23ac068-c418-45e9-8edc-0e541664cbef not found, creating... [ 884.296194] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.296341] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.296520] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.296696] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.296858] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.301025] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.301025] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.301025] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.301025] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.301025] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.301025] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: c23ac068-c418-45e9-8edc-0e541664cbef is going to be created. [ 884.324155] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.324468] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.324627] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.324974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.325945] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.325945] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-c23ac068-c418-45e9-8edc-0e541664cbef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.863154] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 884.863483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.863640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.863932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.867029] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.009767] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 in Status: SUCCESS [ 885.010307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.115203] env[65102]: INFO networking_nsxv3.common.synchronization [req-90952b21-aa72-4357-a8d7-dda43eb92bcb req-3a12d37a-3b1e-46dd-9ef4-1eec359d12a1 service nova] Enqueued Resource ID: 085dab98-e474-491b-84c3-9542fcfa6775 with Priority: HIGHEST for action security_group_rules [ 885.115405] env[65102]: INFO networking_nsxv3.common.synchronization [req-90952b21-aa72-4357-a8d7-dda43eb92bcb req-3a12d37a-3b1e-46dd-9ef4-1eec359d12a1 service nova] Enqueued Resource ID: 085dab98-e474-491b-84c3-9542fcfa6775 with Priority: HIGHEST for action security_group_members [ 885.115631] env[65102]: INFO networking_nsxv3.common.synchronization [req-90952b21-aa72-4357-a8d7-dda43eb92bcb req-3a12d37a-3b1e-46dd-9ef4-1eec359d12a1 service nova] Enqueued Resource ID: c23ac068-c418-45e9-8edc-0e541664cbef with Priority: HIGHEST for action port [ 885.117548] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085dab98-e474-491b-84c3-9542fcfa6775 with Priority: HIGHEST for action security_group_rules [ 885.117548] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085dab98-e474-491b-84c3-9542fcfa6775 with Priority: HIGHEST for action security_group_members [ 885.117548] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c23ac068-c418-45e9-8edc-0e541664cbef with Priority: HIGHEST for action port [ 885.117548] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-085dab98-e474-491b-84c3-9542fcfa6775 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.117736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.117736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.118207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.118207] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('085dab98-e474-491b-84c3-9542fcfa6775',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.120481] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-085dab98-e474-491b-84c3-9542fcfa6775 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.120481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.120481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.120481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.120481] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.120481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.120481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.120481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.120481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.120481] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('085dab98-e474-491b-84c3-9542fcfa6775',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.121893] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-c23ac068-c418-45e9-8edc-0e541664cbef taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.122060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c23ac068-c418-45e9-8edc-0e541664cbef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.122060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c23ac068-c418-45e9-8edc-0e541664cbef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.122219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c23ac068-c418-45e9-8edc-0e541664cbef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.122299] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c23ac068-c418-45e9-8edc-0e541664cbef',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.371972] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.372142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.372216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.372476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.372647] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.372754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.372823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.372992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.373098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.373189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.373284] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.494340] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 885.494621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.494810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.495040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.495240] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.495356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.495520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.495582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.495659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.495746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.495840] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.601868] env[65102]: INFO networking_nsxv3.common.synchronization [req-6d8eab45-c676-471e-956c-2d4fe99b39de req-1edcef29-715f-45e7-ab7d-e7e4b47d0cd6 tempest-ServersTestFqdnHostnames-624065465 tempest-ServersTestFqdnHostnames-624065465-project-member] Enqueued Resource ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 with Priority: HIGHEST for action security_group_members [ 885.602685] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 with Priority: HIGHEST for action security_group_members [ 885.602934] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bf5a5e9-3448-461d-8616-ceb9cef4d902 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.603141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.603224] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.603487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.603649] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.603752] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.603817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.603970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.604073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.604162] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bf5a5e9-3448-461d-8616-ceb9cef4d902',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.624435] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('085dab98-e474-491b-84c3-9542fcfa6775',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.625587] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-085dab98-e474-491b-84c3-9542fcfa6775 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.625752] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.625857] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c23ac068-c418-45e9-8edc-0e541664cbef with status ACTIVE [ 885.626022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.626195] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.626273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.626482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.626577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.626751] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.626851] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.626914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.627133] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.627550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.627550] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.627737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.627829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.627994] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.628089] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.628181] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c23ac068-c418-45e9-8edc-0e541664cbef is going to be updated. [ 885.652291] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.652452] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.652603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.652827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.652969] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.653157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c23ac068-c418-45e9-8edc-0e541664cbef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.881065] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.881065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.881065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.881065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.881065] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.881065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.881065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.881065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.881065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.881065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.881065] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.881065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.881065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.881065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.881065] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.881065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.881890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.881890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.881890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.881890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.881890] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.998483] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.998644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.998736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.998993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.999182] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.999285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.999351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.999587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.999680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.999772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.999916] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.000020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.000081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.000222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.000362] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.000454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.000527] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.000667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.000743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.000825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.000912] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.057880] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-259 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.057880] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-259" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.057880] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-259" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.059768] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-259" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.059768] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.059946] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.060177] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.060602] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.061641] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.061641] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.061641] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.061641] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.061855] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.062140] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.062378] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.063132] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.085212] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.085392] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 886.085589] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.087827] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-259" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.087827] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-b3279b33-9092-457f-88cc-4c2cc95e6cdc taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.087827] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-b3279b33-9092-457f-88cc-4c2cc95e6cdc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.087827] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-b3279b33-9092-457f-88cc-4c2cc95e6cdc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.087827] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-b3279b33-9092-457f-88cc-4c2cc95e6cdc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.087827] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3279b33-9092-457f-88cc-4c2cc95e6cdc',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.106334] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.106526] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.106610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.106868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.106966] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.107179] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.107279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.107362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.107541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.107645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.107756] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 already deleted. [ 886.107863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.130590] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('085dab98-e474-491b-84c3-9542fcfa6775',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.386118] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 220505b1-a182-4b77-b78e-66a35b312ba6: rpc.has_security_group_logging(os_id): False [ 886.405943] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.406218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.406218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.406795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.406795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.406924] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.407038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.407123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.407398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.407499] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.407758] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.407922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.408025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.408170] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.408300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.408538] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.408678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.408742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.408956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.409088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.409208] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 886.477042] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.477216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.477279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.477517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.477681] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.492352] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 886.503642] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for daef1b5a-f25a-405c-9f5a-58444ec5510f: rpc.has_security_group_logging(os_id): False [ 886.533417] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.533417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.533417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.533417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.533417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.533417] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.533417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.533417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.533417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.533417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.533417] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.533417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.533417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.533417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.533963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.533963] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.533963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.534205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.534400] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.534525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.534646] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 886.589463] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.589658] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.589698] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.590344] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.590344] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.590666] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port b3279b33-9092-457f-88cc-4c2cc95e6cdc not found, creating... [ 886.590872] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.591104] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.591438] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.591503] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.591678] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.592050] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.592281] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.592447] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.593032] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.593032] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.593032] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: b3279b33-9092-457f-88cc-4c2cc95e6cdc is going to be created. [ 886.626086] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.626656] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.626914] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.627204] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.627388] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.627652] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-b3279b33-9092-457f-88cc-4c2cc95e6cdc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.633194] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.633328] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.633392] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.633810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.633810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.636707] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.636707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.636707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.636872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.636916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.637015] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085dab98-e474-491b-84c3-9542fcfa6775 is going to be created. [ 886.663403] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 886.674023] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.674023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.674023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.674023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.674023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.703169] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085dab98-e474-491b-84c3-9542fcfa6775 in Status: UNINITIALIZED for 2s [ 887.380551] env[65102]: INFO networking_nsxv3.common.synchronization [req-6d8eab45-c676-471e-956c-2d4fe99b39de req-bd6d0aa6-c95a-4d30-9126-c85f36775dc3 service nova] Enqueued Resource ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 with Priority: HIGHEST for action security_group_rules [ 887.380829] env[65102]: INFO networking_nsxv3.common.synchronization [req-6d8eab45-c676-471e-956c-2d4fe99b39de req-bd6d0aa6-c95a-4d30-9126-c85f36775dc3 service nova] Enqueued Resource ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 with Priority: HIGHEST for action security_group_members [ 887.380933] env[65102]: INFO networking_nsxv3.common.synchronization [req-6d8eab45-c676-471e-956c-2d4fe99b39de req-bd6d0aa6-c95a-4d30-9126-c85f36775dc3 service nova] Enqueued Resource ID: b3279b33-9092-457f-88cc-4c2cc95e6cdc with Priority: HIGHEST for action port [ 887.381567] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 with Priority: HIGHEST for action security_group_rules [ 887.381740] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 with Priority: HIGHEST for action security_group_members [ 887.381845] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3279b33-9092-457f-88cc-4c2cc95e6cdc with Priority: HIGHEST for action port [ 887.382151] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.382280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.382350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.382549] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.382633] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bf5a5e9-3448-461d-8616-ceb9cef4d902',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.384692] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bf5a5e9-3448-461d-8616-ceb9cef4d902 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.384692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.384692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.384692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.384692] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.384692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.385221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.385221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.385221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.385417] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bf5a5e9-3448-461d-8616-ceb9cef4d902',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.386143] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3279b33-9092-457f-88cc-4c2cc95e6cdc taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.386258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3279b33-9092-457f-88cc-4c2cc95e6cdc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.386608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3279b33-9092-457f-88cc-4c2cc95e6cdc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.386608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3279b33-9092-457f-88cc-4c2cc95e6cdc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.386608] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3279b33-9092-457f-88cc-4c2cc95e6cdc',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.525195] env[65102]: INFO networking_nsxv3.common.synchronization [None req-157d2ad8-17fa-4063-8bd3-b19860d2a869 tempest-AttachVolumeShelveTestJSON-733143698 tempest-AttachVolumeShelveTestJSON-733143698-project-member] Enqueued Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_rules [ 887.525195] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_rules [ 887.525195] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01880e80-b093-4590-b2d1-b15567f49135 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.525746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.525746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.525746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.525746] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.757906] env[65102]: INFO networking_nsxv3.common.synchronization [req-de0d9950-4995-4978-af62-464a4ac42ae5 req-f3fc26b6-6f54-4f0a-94a2-13fc9d869961 tempest-ImagesTestJSON-2026451637 tempest-ImagesTestJSON-2026451637-project-member] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 887.758487] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 887.758805] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.758925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.758985] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.759311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.759520] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.759987] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.760108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.760337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.760459] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.760605] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.888886] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bf5a5e9-3448-461d-8616-ceb9cef4d902 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.889116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.889313] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2bf5a5e9-3448-461d-8616-ceb9cef4d902',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.890756] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3279b33-9092-457f-88cc-4c2cc95e6cdc with status ACTIVE [ 887.891012] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.891155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.891233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.891475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.891621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.891854] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.891979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.892163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.892277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.892365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.892578] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.892691] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.892770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.892935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.893032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.893130] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3279b33-9092-457f-88cc-4c2cc95e6cdc is going to be updated. [ 887.922875] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.923116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.923217] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.923542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.923785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.924063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3279b33-9092-457f-88cc-4c2cc95e6cdc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.064809] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.064943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.064943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.065461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.065607] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.066328] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01880e80-b093-4590-b2d1-b15567f49135 already deleted. [ 888.066574] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.078532] env[65102]: INFO networking_nsxv3.common.synchronization [None req-814555ce-0cac-42c8-b7f6-635a017deace tempest-AttachVolumeShelveTestJSON-733143698 tempest-AttachVolumeShelveTestJSON-733143698-project-member] Enqueued Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_rules [ 888.080793] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_rules [ 888.081426] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01880e80-b093-4590-b2d1-b15567f49135 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.081426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.081532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.081782] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.081862] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.262764] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.262870] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.262918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.263179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.263278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.263478] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.263576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.263665] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.263788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.263971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.263971] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be updated. [ 888.299293] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.300110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.300324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.300639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.300915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.313011] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 888.395592] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2bf5a5e9-3448-461d-8616-ceb9cef4d902',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.418553] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.418763] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.418866] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.419152] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.419477] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.419944] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.420070] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.420296] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.420711] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.420968] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.421098] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.421209] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.421315] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.421423] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 888.421525] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.421682] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.446412] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.446697] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 888.446924] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.447173] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.447557] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-355ade04-dfe9-489a-81d1-b7bee4c4833e taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.447851] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-355ade04-dfe9-489a-81d1-b7bee4c4833e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.448395] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-355ade04-dfe9-489a-81d1-b7bee4c4833e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.448395] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-355ade04-dfe9-489a-81d1-b7bee4c4833e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.448501] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('355ade04-dfe9-489a-81d1-b7bee4c4833e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.508652] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 888.508916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.606656] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.606850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.606928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.607580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.607580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.607580] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01880e80-b093-4590-b2d1-b15567f49135 already deleted. [ 888.607580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.685787] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 888.686106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.717402] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085dab98-e474-491b-84c3-9542fcfa6775 in Status: SUCCESS [ 888.717705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.717935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.718246] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.718835] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.718835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.718835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.719058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.719058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.719133] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.719256] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('085dab98-e474-491b-84c3-9542fcfa6775',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.898072] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.898257] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.898326] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.898561] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.898654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.898753] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 is going to be created. [ 888.926536] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.926536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.926536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.926536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.926536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.935229] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 in Status: UNINITIALIZED for 2s [ 888.954028] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.954028] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.954028] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.954028] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.954028] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.954028] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 355ade04-dfe9-489a-81d1-b7bee4c4833e not found, creating... [ 888.954028] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.954028] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.954028] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.954028] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.954028] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.955778] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.955778] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.955778] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.958228] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.958228] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.958228] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 355ade04-dfe9-489a-81d1-b7bee4c4833e is going to be created. [ 888.978274] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.978274] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.978274] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.978274] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.978274] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.978274] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-355ade04-dfe9-489a-81d1-b7bee4c4833e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.221472] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-085dab98-e474-491b-84c3-9542fcfa6775 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.221714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.221799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.222111] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.222331] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.222481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.222572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.222772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.222893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.223016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.223207] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-085dab98-e474-491b-84c3-9542fcfa6775 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.223333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.223414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.223591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.223765] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.223900] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.223986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.224176] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.224275] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.224790] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.224790] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('085dab98-e474-491b-84c3-9542fcfa6775',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.719606] env[65102]: INFO networking_nsxv3.common.synchronization [req-de0d9950-4995-4978-af62-464a4ac42ae5 req-67b0d734-e5cd-4068-a8e3-bd528b710aa6 service nova] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_rules [ 889.719862] env[65102]: INFO networking_nsxv3.common.synchronization [req-de0d9950-4995-4978-af62-464a4ac42ae5 req-67b0d734-e5cd-4068-a8e3-bd528b710aa6 service nova] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 889.719954] env[65102]: INFO networking_nsxv3.common.synchronization [req-de0d9950-4995-4978-af62-464a4ac42ae5 req-67b0d734-e5cd-4068-a8e3-bd528b710aa6 service nova] Enqueued Resource ID: 355ade04-dfe9-489a-81d1-b7bee4c4833e with Priority: HIGHEST for action port [ 889.720496] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_rules [ 889.720639] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 889.720737] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 355ade04-dfe9-489a-81d1-b7bee4c4833e with Priority: HIGHEST for action port [ 889.721027] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.723760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.723760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.723760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.723760] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.723985] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.724154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.724390] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-355ade04-dfe9-489a-81d1-b7bee4c4833e taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.724529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-355ade04-dfe9-489a-81d1-b7bee4c4833e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.724621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-355ade04-dfe9-489a-81d1-b7bee4c4833e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.724824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-355ade04-dfe9-489a-81d1-b7bee4c4833e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.725086] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('355ade04-dfe9-489a-81d1-b7bee4c4833e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.726252] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 085dab98-e474-491b-84c3-9542fcfa6775: rpc.has_security_group_logging(os_id): False [ 889.747576] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.747740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.747814] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.748035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.748130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.748315] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.748411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.748474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.748626] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.748705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.748897] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.748992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.749070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.749211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.749286] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.749475] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.749564] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.749654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.749819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.749899] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.749987] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 085dab98-e474-491b-84c3-9542fcfa6775 is going to be created. [ 889.809923] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.810102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.810165] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.810367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.810544] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.823827] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 085dab98-e474-491b-84c3-9542fcfa6775 in Status: IN_PROGRESS for 2s [ 890.226837] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.227176] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.227395] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 355ade04-dfe9-489a-81d1-b7bee4c4833e with status ACTIVE [ 890.227929] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.227929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.227929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.228089] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.228255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.228421] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.228589] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.228816] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.228916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.229177] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.229279] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.229419] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.229508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.229707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.229821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.229941] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 355ade04-dfe9-489a-81d1-b7bee4c4833e is going to be updated. [ 890.254315] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.254492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.254492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.254676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.254838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.254998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-355ade04-dfe9-489a-81d1-b7bee4c4833e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.334149] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 890.334149] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad deletion is rescheduled due to dependency. [ 890.334149] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.334149] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.334149] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.334149] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.334618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.334618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.334618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.334618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.334618] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.444683] env[65102]: INFO networking_nsxv3.common.synchronization [None req-a8474b65-1658-472d-823a-539fa9c2de7f tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGHEST for action security_group_rules [ 890.445289] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGHEST for action security_group_rules [ 890.445698] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.445758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.445888] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.446091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.446171] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be29eb73-d99e-4af1-ad2e-c5ce871f7807',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.725904] env[65102]: INFO networking_nsxv3.common.synchronization [None req-cad20259-7f43-4af8-af21-2f53a6dacffe tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGHEST for action security_group_rules [ 890.726872] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGHEST for action security_group_rules [ 890.727757] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.727868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.837365] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.948153] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 in Status: SUCCESS [ 890.948153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.948153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.948153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.948153] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.948153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.948153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.948153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.948153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.948153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.948153] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2bf5a5e9-3448-461d-8616-ceb9cef4d902',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.978653] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.978653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.978653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.978653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.978653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.978653] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 already deleted. [ 890.978653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.978653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.978653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.978653] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be29eb73-d99e-4af1-ad2e-c5ce871f7807',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.340381] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.450552] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2bf5a5e9-3448-461d-8616-ceb9cef4d902',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.508844] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.508987] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.509703] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.509703] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.509703] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.509703] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 already deleted. [ 891.509703] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.835951] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 085dab98-e474-491b-84c3-9542fcfa6775 in Status: SUCCESS [ 891.836242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.842955] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.843184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.843241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.843452] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.843878] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.843993] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be updated. [ 891.893422] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.893655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.893773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.894126] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.894372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.905439] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 891.953056] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2bf5a5e9-3448-461d-8616-ceb9cef4d902: rpc.has_security_group_logging(os_id): False [ 891.970519] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.970664] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.970732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.970938] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.971041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.971375] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.971484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.971548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.971759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.971887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.971944] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 is going to be created. [ 892.046472] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.046662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.046700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.046894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.047144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.064737] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 in Status: IN_PROGRESS for 2s [ 892.802536] env[65102]: INFO networking_nsxv3.common.synchronization [req-2be82be7-7ac9-42a8-b020-4b3415194486 req-81b137ad-b2e0-4c8a-8fee-bce7cb0986c4 tempest-ListServerFiltersTestJSON-1901090165 tempest-ListServerFiltersTestJSON-1901090165-project-member] Enqueued Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 892.802674] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 892.803305] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.803305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.803305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.803518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.803637] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.803734] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.803800] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.803980] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.804103] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.804221] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.306956] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.715257] env[65102]: INFO networking_nsxv3.common.synchronization [None req-7758115e-5a2d-4b77-abb4-10d0a38395b2 None None] Enqueued Resource ID: a76b1487-338b-41e7-912c-2e713a577dea with Priority: HIGHEST for action port [ 893.715257] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a76b1487-338b-41e7-912c-2e713a577dea with Priority: HIGHEST for action port [ 893.718060] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-a76b1487-338b-41e7-912c-2e713a577dea taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.718060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a76b1487-338b-41e7-912c-2e713a577dea" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.718060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a76b1487-338b-41e7-912c-2e713a577dea" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.718060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a76b1487-338b-41e7-912c-2e713a577dea" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.718060] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a76b1487-338b-41e7-912c-2e713a577dea',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.811835] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.918176] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 893.918176] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.918176] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.918176] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.918425] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.918425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.918501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.918718] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.918718] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.918838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.918905] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.080061] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 in Status: SUCCESS [ 894.080061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.220176] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a76b1487-338b-41e7-912c-2e713a577dea [ 894.220421] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.220559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.221250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.221250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.221250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.221250] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a76b1487-338b-41e7-912c-2e713a577dea already deleted. [ 894.221250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a76b1487-338b-41e7-912c-2e713a577dea" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.315090] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.315090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.315090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.315090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.315090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.315090] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1966cd49-8e43-4ab8-862a-7f66af79660a is going to be updated. [ 894.350102] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.350102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.350102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.350102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.353142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.362916] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: IN_PROGRESS for 2s [ 894.421542] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.421542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.421542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.421542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.422126] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.422126] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.422126] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.422126] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.422462] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.422462] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.422611] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.422698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.422872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.423203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.423203] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.423481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.423481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.423481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.423481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.423760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.423760] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.926440] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad: rpc.has_security_group_logging(os_id): False [ 894.945424] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.945594] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.945669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.945899] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.945982] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.946695] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.947370] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.947447] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.947637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.947769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.948069] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.948153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.948236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.948411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.948523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.948747] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.948881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.948974] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.949163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.949277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.949391] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be updated. [ 894.972806] env[65102]: INFO networking_nsxv3.common.synchronization [None req-9bda5eab-138c-43fd-942a-701e4e49228b None None] Enqueued Resource ID: ace8eb7d-ed3d-458d-abe4-1cd9513b5358 with Priority: HIGHEST for action port [ 894.973426] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ace8eb7d-ed3d-458d-abe4-1cd9513b5358 with Priority: HIGHEST for action port [ 894.973750] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-ace8eb7d-ed3d-458d-abe4-1cd9513b5358 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.973856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ace8eb7d-ed3d-458d-abe4-1cd9513b5358" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.974306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ace8eb7d-ed3d-458d-abe4-1cd9513b5358" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.974995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ace8eb7d-ed3d-458d-abe4-1cd9513b5358" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.975159] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ace8eb7d-ed3d-458d-abe4-1cd9513b5358',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.054745] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.055682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.056211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.056468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.056664] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.078869] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 895.483102] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ace8eb7d-ed3d-458d-abe4-1cd9513b5358 [ 895.483102] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.483102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.483102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.483102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.483102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.483102] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ace8eb7d-ed3d-458d-abe4-1cd9513b5358 already deleted. [ 895.483102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ace8eb7d-ed3d-458d-abe4-1cd9513b5358" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.197035] env[65102]: INFO networking_nsxv3.common.synchronization [req-fa5c3023-b677-467e-a9ee-523221a5ff14 req-6e6e2e4a-fb8c-41ea-bbb0-179b730436ac tempest-ServerExternalEventsTest-2032441286 tempest-ServerExternalEventsTest-2032441286-project-member] Enqueued Resource ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef with Priority: HIGHEST for action security_group_members [ 896.197629] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef with Priority: HIGHEST for action security_group_members [ 896.197980] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1b926d4-3a35-4d53-823e-1d4fbac254ef taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.198323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.198403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.199259] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.199259] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.199259] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.199259] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.199259] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.199259] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.199465] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1b926d4-3a35-4d53-823e-1d4fbac254ef',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.375722] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: SUCCESS [ 896.375963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.408782] env[65102]: INFO networking_nsxv3.common.synchronization [None req-c0a2f89e-b1b6-4b7d-9ee8-48f0bf28062a None None] Enqueued Resource ID: a9ce69b6-d7dd-4473-80fc-e0cb7d52eae4 with Priority: HIGHEST for action port [ 896.409135] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ce69b6-d7dd-4473-80fc-e0cb7d52eae4 with Priority: HIGHEST for action port [ 896.409407] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9ce69b6-d7dd-4473-80fc-e0cb7d52eae4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.409525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9ce69b6-d7dd-4473-80fc-e0cb7d52eae4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.409582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9ce69b6-d7dd-4473-80fc-e0cb7d52eae4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.410221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9ce69b6-d7dd-4473-80fc-e0cb7d52eae4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.410312] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9ce69b6-d7dd-4473-80fc-e0cb7d52eae4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.703508] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.703508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.703508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.703508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.703508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.704533] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.704533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.704533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.704533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.704668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.705500] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef already deleted. [ 896.705500] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.905303] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.905303] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.905566] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.905977] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.910098] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.910098] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.910098] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.910098] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.910098] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.910098] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 896.910098] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 896.910098] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 896.910098] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 896.910098] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 896.910098] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 896.910098] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 896.911988] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9ce69b6-d7dd-4473-80fc-e0cb7d52eae4 [ 896.912915] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.913511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.914053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.914416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.914798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.914798] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9ce69b6-d7dd-4473-80fc-e0cb7d52eae4 already deleted. [ 896.915063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9ce69b6-d7dd-4473-80fc-e0cb7d52eae4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.931802] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 896.932383] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 896.935017] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 896.935017] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.935017] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-03fa2dfb-b370-41bb-ab18-1d3af50fd4d9 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.935017] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-03fa2dfb-b370-41bb-ab18-1d3af50fd4d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.935017] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-03fa2dfb-b370-41bb-ab18-1d3af50fd4d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.935017] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-03fa2dfb-b370-41bb-ab18-1d3af50fd4d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.935017] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03fa2dfb-b370-41bb-ab18-1d3af50fd4d9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.090962] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 897.091227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.408028] env[65102]: INFO networking_nsxv3.common.synchronization [None req-0e2e6e33-8060-46a5-afc6-7180855eb3ac None None] Enqueued Resource ID: 1e784b4c-52b4-402f-bb11-c1e41ddb5f7b with Priority: HIGHEST for action port [ 897.408992] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e784b4c-52b4-402f-bb11-c1e41ddb5f7b with Priority: HIGHEST for action port [ 897.409079] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e784b4c-52b4-402f-bb11-c1e41ddb5f7b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.409195] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e784b4c-52b4-402f-bb11-c1e41ddb5f7b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.409291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e784b4c-52b4-402f-bb11-c1e41ddb5f7b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.409583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e784b4c-52b4-402f-bb11-c1e41ddb5f7b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.409877] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e784b4c-52b4-402f-bb11-c1e41ddb5f7b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.436830] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.438037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.438037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.438037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.438037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.438243] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 03fa2dfb-b370-41bb-ab18-1d3af50fd4d9 not found, creating... [ 897.438521] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.438710] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.438856] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.439256] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.439457] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.439823] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.440029] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.440850] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.441231] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.441407] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.441536] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 03fa2dfb-b370-41bb-ab18-1d3af50fd4d9 is going to be created. [ 897.465956] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.465956] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.465956] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.465956] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.466338] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.466338] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-03fa2dfb-b370-41bb-ab18-1d3af50fd4d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.913646] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e784b4c-52b4-402f-bb11-c1e41ddb5f7b [ 897.914277] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.914596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.914746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.915037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.915352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.915352] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e784b4c-52b4-402f-bb11-c1e41ddb5f7b already deleted. [ 897.915485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e784b4c-52b4-402f-bb11-c1e41ddb5f7b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.226607] env[65102]: INFO networking_nsxv3.common.synchronization [req-fa5c3023-b677-467e-a9ee-523221a5ff14 req-5155af1b-ae50-4087-a9b1-603c6189fe13 service nova] Enqueued Resource ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef with Priority: HIGHEST for action security_group_rules [ 898.228582] env[65102]: INFO networking_nsxv3.common.synchronization [req-fa5c3023-b677-467e-a9ee-523221a5ff14 req-5155af1b-ae50-4087-a9b1-603c6189fe13 service nova] Enqueued Resource ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef with Priority: HIGHEST for action security_group_members [ 898.228582] env[65102]: INFO networking_nsxv3.common.synchronization [req-fa5c3023-b677-467e-a9ee-523221a5ff14 req-5155af1b-ae50-4087-a9b1-603c6189fe13 service nova] Enqueued Resource ID: 03fa2dfb-b370-41bb-ab18-1d3af50fd4d9 with Priority: HIGHEST for action port [ 898.228582] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef with Priority: HIGHEST for action security_group_rules [ 898.228582] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef with Priority: HIGHEST for action security_group_members [ 898.228582] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03fa2dfb-b370-41bb-ab18-1d3af50fd4d9 with Priority: HIGHEST for action port [ 898.228582] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1b926d4-3a35-4d53-823e-1d4fbac254ef taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.228582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.228582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.229020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.229020] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1b926d4-3a35-4d53-823e-1d4fbac254ef',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.230037] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1b926d4-3a35-4d53-823e-1d4fbac254ef taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.230163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.230163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.230354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.230513] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.230616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.230680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.230825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.230911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.231016] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1b926d4-3a35-4d53-823e-1d4fbac254ef',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.232572] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-03fa2dfb-b370-41bb-ab18-1d3af50fd4d9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.232572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03fa2dfb-b370-41bb-ab18-1d3af50fd4d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.232572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03fa2dfb-b370-41bb-ab18-1d3af50fd4d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.232572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03fa2dfb-b370-41bb-ab18-1d3af50fd4d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.232572] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03fa2dfb-b370-41bb-ab18-1d3af50fd4d9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.720485] env[65102]: INFO networking_nsxv3.common.synchronization [req-e56cb657-51ef-4dc4-8183-a597b00d27f6 req-1f65bdf2-1cd3-4632-8b34-3023f2de4871 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 898.720682] env[65102]: INFO networking_nsxv3.common.synchronization [req-e56cb657-51ef-4dc4-8183-a597b00d27f6 req-1f65bdf2-1cd3-4632-8b34-3023f2de4871 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGHEST for action security_group_members [ 898.723253] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 898.723554] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGHEST for action security_group_members [ 898.724135] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.724232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.724316] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.724819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.724819] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.724819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.724819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.725179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.725179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.725179] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.726487] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-44ad09c8-ee6b-4496-8939-cd6fba160843 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.726487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.726487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.726487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.726679] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.726721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.726818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.727626] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.727626] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.727626] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.734019] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1b926d4-3a35-4d53-823e-1d4fbac254ef',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.735118] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1b926d4-3a35-4d53-823e-1d4fbac254ef taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.735118] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.735349] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03fa2dfb-b370-41bb-ab18-1d3af50fd4d9 with status ACTIVE [ 898.735400] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.736431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.736431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.736431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.736431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.736431] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.736431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.736431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.736431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.736860] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.736860] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.736965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.736965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.737144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.737222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.737673] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03fa2dfb-b370-41bb-ab18-1d3af50fd4d9 is going to be updated. [ 898.770130] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.770320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.770388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.770650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.770796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.770970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03fa2dfb-b370-41bb-ab18-1d3af50fd4d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.777655] env[65102]: INFO networking_nsxv3.common.synchronization [req-e56cb657-51ef-4dc4-8183-a597b00d27f6 req-1f65bdf2-1cd3-4632-8b34-3023f2de4871 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGHEST for action security_group_rules [ 898.777891] env[65102]: INFO networking_nsxv3.common.synchronization [req-e56cb657-51ef-4dc4-8183-a597b00d27f6 req-1f65bdf2-1cd3-4632-8b34-3023f2de4871 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGHEST for action security_group_members [ 898.778055] env[65102]: INFO networking_nsxv3.common.synchronization [req-e56cb657-51ef-4dc4-8183-a597b00d27f6 req-1f65bdf2-1cd3-4632-8b34-3023f2de4871 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_rules [ 898.778106] env[65102]: INFO networking_nsxv3.common.synchronization [req-e56cb657-51ef-4dc4-8183-a597b00d27f6 req-1f65bdf2-1cd3-4632-8b34-3023f2de4871 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 898.778353] env[65102]: INFO networking_nsxv3.common.synchronization [req-e56cb657-51ef-4dc4-8183-a597b00d27f6 req-1f65bdf2-1cd3-4632-8b34-3023f2de4871 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 190c1749-3fb8-4199-b8e7-1ab227d2b30f with Priority: HIGHEST for action port [ 898.779034] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGHEST for action security_group_rules [ 898.779186] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_rules [ 898.779326] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190c1749-3fb8-4199-b8e7-1ab227d2b30f with Priority: HIGHEST for action port [ 898.779373] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGHEST for action security_group_members [ 898.779463] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 898.779747] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44ad09c8-ee6b-4496-8939-cd6fba160843 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.779871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.779931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.780244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.780324] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.781578] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.781722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.781919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.782452] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.782452] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.783669] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-190c1749-3fb8-4199-b8e7-1ab227d2b30f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.783809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.783868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.784084] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.784084] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('190c1749-3fb8-4199-b8e7-1ab227d2b30f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.785251] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-44ad09c8-ee6b-4496-8939-cd6fba160843 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.785348] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.785910] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.785910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.162281] env[65102]: INFO networking_nsxv3.common.synchronization [None req-f7bf4c11-2fc3-471f-9e03-e1e2e5cbd89f None None] Enqueued Resource ID: e6660582-9ae2-4175-9a35-f9ded8e1c189 with Priority: HIGHEST for action port [ 899.162637] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6660582-9ae2-4175-9a35-f9ded8e1c189 with Priority: HIGHEST for action port [ 899.162868] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6660582-9ae2-4175-9a35-f9ded8e1c189 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.163095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6660582-9ae2-4175-9a35-f9ded8e1c189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.163252] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6660582-9ae2-4175-9a35-f9ded8e1c189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.163560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6660582-9ae2-4175-9a35-f9ded8e1c189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.163708] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6660582-9ae2-4175-9a35-f9ded8e1c189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.228746] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.231290] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.239751] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1b926d4-3a35-4d53-823e-1d4fbac254ef',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.284646] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.284646] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.286102] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 190c1749-3fb8-4199-b8e7-1ab227d2b30f with status ACTIVE [ 899.286397] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.286481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.286564] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.287172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.287620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.288035] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.288205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.288286] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.288579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.288753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.288975] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.289090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.289157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.289308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.289388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.289497] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 190c1749-3fb8-4199-b8e7-1ab227d2b30f is going to be updated. [ 899.290965] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-44ad09c8-ee6b-4496-8939-cd6fba160843 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.291100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.314508] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.314653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.314725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.314931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.315084] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.315250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.665856] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e6660582-9ae2-4175-9a35-f9ded8e1c189 [ 899.666134] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.666272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.666361] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.666553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.666651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.666733] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e6660582-9ae2-4175-9a35-f9ded8e1c189 already deleted. [ 899.666819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6660582-9ae2-4175-9a35-f9ded8e1c189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.731196] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.733931] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.741794] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.742495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.742495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.742495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.742684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.742684] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef is going to be created. [ 899.771368] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.771368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.771368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.771368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.771368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.782266] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef in Status: UNINITIALIZED for 2s [ 900.234450] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.235026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.235026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.235026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.235295] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.235295] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 900.236532] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.236688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.236748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.236968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.236968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.237063] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 is going to be created. [ 900.268440] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.268440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.268440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.268440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.268440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.272025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.272200] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.272293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.273949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.274777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.277510] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: UNINITIALIZED for 2s [ 900.289111] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 900.879397] env[65102]: INFO networking_nsxv3.common.synchronization [None req-760098d3-6e83-45af-abb7-43f12234a17b None None] Enqueued Resource ID: 1b26cd71-617f-40da-93d6-ab787dece808 with Priority: HIGHEST for action port [ 900.880428] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b26cd71-617f-40da-93d6-ab787dece808 with Priority: HIGHEST for action port [ 900.880428] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b26cd71-617f-40da-93d6-ab787dece808 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.880428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b26cd71-617f-40da-93d6-ab787dece808" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.880428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b26cd71-617f-40da-93d6-ab787dece808" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.880693] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b26cd71-617f-40da-93d6-ab787dece808" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.880779] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b26cd71-617f-40da-93d6-ab787dece808',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.384502] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b26cd71-617f-40da-93d6-ab787dece808 [ 901.384951] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.385130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.385327] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.385613] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.385705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.386235] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b26cd71-617f-40da-93d6-ab787dece808 already deleted. [ 901.386372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b26cd71-617f-40da-93d6-ab787dece808" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.801988] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef in Status: SUCCESS [ 901.802686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.802686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.802937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.803068] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.803154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.803253] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.803457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.803578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.803645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.803737] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1b926d4-3a35-4d53-823e-1d4fbac254ef',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.241593] env[65102]: INFO networking_nsxv3.common.synchronization [req-706917ab-2b8b-4485-bd6c-1591c5b4f70f req-220e6182-e80a-4bbb-8055-2526ee123696 tempest-ServersTestMultiNic-160748370 tempest-ServersTestMultiNic-160748370-project-member] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 902.242165] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 902.242517] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.242811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.242811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.242918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.243087] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.243186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.243248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.243469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.243517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.243598] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.290470] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: SUCCESS [ 902.290470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.290470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.290470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.290470] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.290470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.290470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.290470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.290470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.290470] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.302660] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 902.303250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.303250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.303344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.303649] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.303734] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.303971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.303971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.304110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.304110] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.307891] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1b926d4-3a35-4d53-823e-1d4fbac254ef taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.308110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.308196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.308467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.308666] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.308948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.308948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.309041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.309112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.309597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.309597] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1b926d4-3a35-4d53-823e-1d4fbac254ef taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.309597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.309597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.309762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.309876] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.309943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.310010] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.310148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.310220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.310323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.310748] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1b926d4-3a35-4d53-823e-1d4fbac254ef',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.495706] env[65102]: INFO networking_nsxv3.common.synchronization [req-706917ab-2b8b-4485-bd6c-1591c5b4f70f req-0ea350da-a8f3-4545-b793-d0b3c3878843 tempest-ServersTestMultiNic-160748370 tempest-ServersTestMultiNic-160748370-project-member] Enqueued Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 902.496327] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 220505b1-a182-4b77-b78e-66a35b312ba6 with Priority: HIGHEST for action security_group_members [ 902.496687] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-220505b1-a182-4b77-b78e-66a35b312ba6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.496908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.746404] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.793755] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.813986] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.816076] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1b926d4-3a35-4d53-823e-1d4fbac254ef: rpc.has_security_group_logging(os_id): False [ 902.839056] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.839228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.839276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.839471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.839560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.839785] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.839885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.840043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.840178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.840221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.840505] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.840610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.840677] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.840826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.841220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.841618] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.841618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.841618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.841780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.841857] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.841956] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef is going to be created. [ 902.913356] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.913554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.913603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.913790] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.913977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.927208] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef in Status: IN_PROGRESS for 2s [ 903.250344] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.282955] env[65102]: INFO networking_nsxv3.common.synchronization [req-b53a5ec1-c04a-4d93-aee0-ffd1fc16028d req-a5c184b4-9df4-4c7d-b5af-1bd239cd384d tempest-ServerGroupTestJSON-1803090293 tempest-ServerGroupTestJSON-1803090293-project-member] Enqueued Resource ID: 085dab98-e474-491b-84c3-9542fcfa6775 with Priority: HIGHEST for action security_group_members [ 903.283523] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085dab98-e474-491b-84c3-9542fcfa6775 with Priority: HIGHEST for action security_group_members [ 903.283831] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-085dab98-e474-491b-84c3-9542fcfa6775 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.284090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.284090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.284229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.284379] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.284481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.284542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.284687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.284773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.284865] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('085dab98-e474-491b-84c3-9542fcfa6775',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.296602] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.316827] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.753628] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.753948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.753948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.756199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.756199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.756275] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 903.788029] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.788029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.788029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.788029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.788029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.788029] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.788029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.788408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.788408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.788408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.788408] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085dab98-e474-491b-84c3-9542fcfa6775 is going to be updated. [ 903.801291] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.801518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.801518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.802640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.802640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.804557] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.804732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.804827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.805042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.805128] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.805231] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 is going to be updated. [ 903.822661] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 903.824189] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.824341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.824494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.824640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.824756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.824890] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 903.863235] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.863764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.863764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.866733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.866733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.866733] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.866733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.866733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.866733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.866733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.868284] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.868284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.868499] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.868545] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.868647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.878215] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: IN_PROGRESS for 2s [ 903.878924] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085dab98-e474-491b-84c3-9542fcfa6775 in Status: IN_PROGRESS for 2s [ 903.879502] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 904.128696] env[65102]: INFO networking_nsxv3.common.synchronization [req-25ae0973-f3ac-4589-bf42-6d8520645b36 req-394c81e6-f435-4200-b1eb-c636a57ede3a tempest-DeleteServersTestJSON-1773899535 tempest-DeleteServersTestJSON-1773899535-project-member] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 904.129076] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 904.129387] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.129522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.129566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.130255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.130255] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.130255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.130255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.130255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.130255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.130555] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.633043] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.633233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.633233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.633992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.633992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.633992] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.633992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.634551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.634551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.634551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.634551] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 904.673762] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.674426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.674426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.674690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.675193] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.687336] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 904.940881] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef in Status: SUCCESS [ 904.940881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.836020] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 905.836020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.836020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.836020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.836020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.836020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.836020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.836020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.836020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.836020] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('220505b1-a182-4b77-b78e-66a35b312ba6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.892703] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 085dab98-e474-491b-84c3-9542fcfa6775 in Status: SUCCESS [ 905.894947] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 085dab98-e474-491b-84c3-9542fcfa6775 deletion is rescheduled due to dependency. [ 905.894947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.894947] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 905.894947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.896281] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: SUCCESS [ 905.896698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.899034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.899034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.899034] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.899034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.899034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.900825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.900825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.900825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.900825] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.901231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.901514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.902123] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.902123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.902123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.902123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.902300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.902300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.902375] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.339277] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.339639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.339639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.339900] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.340013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.340137] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.340236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.340293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.340446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.340600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.340736] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 is going to be updated. [ 906.375956] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.376149] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.376250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.376429] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.376577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.388684] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: IN_PROGRESS for 2s [ 906.405727] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.405998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.406112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.406554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.406978] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.406978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.407128] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.407277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.407378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.408364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.408364] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.408364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.408364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.408364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.409088] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.409088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.409088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.409088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.409088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.409088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.409325] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.410216] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.702992] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 906.702992] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f deletion is rescheduled due to dependency. [ 906.702992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.912542] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for daef1b5a-f25a-405c-9f5a-58444ec5510f: rpc.has_security_group_logging(os_id): False [ 906.913920] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44ad09c8-ee6b-4496-8939-cd6fba160843: rpc.has_security_group_logging(os_id): False [ 906.935458] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.935645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.935781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.935895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.935987] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.936231] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.936334] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.936398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.936549] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.936626] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.936715] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 is going to be created. [ 906.943254] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.943254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.943254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.943254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.943254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.943254] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.943581] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.943581] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.943581] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.943759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.943828] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.943921] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.943981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.944157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.944233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.944446] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.944541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.944615] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.944769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.944844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.944973] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 907.037186] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.037186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.037186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.040074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.040555] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.043562] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.043911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.044151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.044290] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.044482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.075669] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: IN_PROGRESS for 2s [ 907.091278] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 907.370126] env[65102]: INFO networking_nsxv3.common.synchronization [req-fc1183fc-f653-4f4b-920a-7c7858bfb0b0 req-d382d76c-53f5-455f-85ea-160a57562391 tempest-MigrationsAdminTest-673773847 tempest-MigrationsAdminTest-673773847-project-member] Enqueued Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_members [ 907.372239] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGHEST for action security_group_members [ 907.372239] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.372239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.372239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.372239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.372239] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.372239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.372239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.372239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.372239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.372865] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.874837] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.875361] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.875463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.875704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.875807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.876106] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.876231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.876305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.876519] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.876631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.876731] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 is going to be updated. [ 907.910166] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.910166] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.910166] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.910166] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.910166] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.922541] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: IN_PROGRESS for 2s [ 908.401137] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 220505b1-a182-4b77-b78e-66a35b312ba6 in Status: SUCCESS [ 908.401438] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 220505b1-a182-4b77-b78e-66a35b312ba6 deletion is rescheduled due to dependency. [ 908.401471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-220505b1-a182-4b77-b78e-66a35b312ba6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.431023] env[65102]: INFO networking_nsxv3.common.synchronization [req-b0aa1416-7be0-4444-8694-ecad6ac6107e req-4201441d-99f3-4ed0-96f5-a312c163f4a4 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 908.431023] env[65102]: INFO networking_nsxv3.common.synchronization [req-b0aa1416-7be0-4444-8694-ecad6ac6107e req-4201441d-99f3-4ed0-96f5-a312c163f4a4 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGHEST for action security_group_members [ 908.431023] env[65102]: INFO networking_nsxv3.common.synchronization [req-b0aa1416-7be0-4444-8694-ecad6ac6107e req-4201441d-99f3-4ed0-96f5-a312c163f4a4 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 with Priority: HIGHEST for action security_group_members [ 908.431590] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 908.431807] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGHEST for action security_group_members [ 908.432015] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 with Priority: HIGHEST for action security_group_members [ 908.432424] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.433786] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.436097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.436097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.436097] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.436097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.436097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.436097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.436097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.436097] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.436097] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-44ad09c8-ee6b-4496-8939-cd6fba160843 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.436553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.436705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.436953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.437325] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.437558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.437714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.437978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.438218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.438565] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.441601] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-45940cc3-3a03-4a7f-9cef-9063b50303f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.441601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.441601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.441601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.441601] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.441601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.441601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.441601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.441601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.441601] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45940cc3-3a03-4a7f-9cef-9063b50303f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.480393] env[65102]: INFO networking_nsxv3.common.synchronization [req-b0aa1416-7be0-4444-8694-ecad6ac6107e req-4201441d-99f3-4ed0-96f5-a312c163f4a4 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGHEST for action security_group_rules [ 908.480393] env[65102]: INFO networking_nsxv3.common.synchronization [req-b0aa1416-7be0-4444-8694-ecad6ac6107e req-4201441d-99f3-4ed0-96f5-a312c163f4a4 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGHEST for action security_group_members [ 908.480393] env[65102]: INFO networking_nsxv3.common.synchronization [req-b0aa1416-7be0-4444-8694-ecad6ac6107e req-4201441d-99f3-4ed0-96f5-a312c163f4a4 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 with Priority: HIGHEST for action security_group_rules [ 908.480393] env[65102]: INFO networking_nsxv3.common.synchronization [req-b0aa1416-7be0-4444-8694-ecad6ac6107e req-4201441d-99f3-4ed0-96f5-a312c163f4a4 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 with Priority: HIGHEST for action security_group_members [ 908.480597] env[65102]: INFO networking_nsxv3.common.synchronization [req-b0aa1416-7be0-4444-8694-ecad6ac6107e req-4201441d-99f3-4ed0-96f5-a312c163f4a4 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_rules [ 908.480597] env[65102]: INFO networking_nsxv3.common.synchronization [req-b0aa1416-7be0-4444-8694-ecad6ac6107e req-4201441d-99f3-4ed0-96f5-a312c163f4a4 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 908.480751] env[65102]: INFO networking_nsxv3.common.synchronization [req-b0aa1416-7be0-4444-8694-ecad6ac6107e req-4201441d-99f3-4ed0-96f5-a312c163f4a4 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 190c1749-3fb8-4199-b8e7-1ab227d2b30f with Priority: HIGHEST for action port [ 908.481956] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGHEST for action security_group_rules [ 908.482180] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 with Priority: HIGHEST for action security_group_rules [ 908.482318] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 908.482531] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190c1749-3fb8-4199-b8e7-1ab227d2b30f with Priority: HIGHEST for action port [ 908.482664] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_rules [ 908.482816] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGHEST for action security_group_members [ 908.482968] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 with Priority: HIGHEST for action security_group_members [ 908.483298] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44ad09c8-ee6b-4496-8939-cd6fba160843 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.483437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.483764] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45940cc3-3a03-4a7f-9cef-9063b50303f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.484088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.484215] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.484490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.484606] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45940cc3-3a03-4a7f-9cef-9063b50303f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.487645] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.487645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.487645] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-190c1749-3fb8-4199-b8e7-1ab227d2b30f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.487645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.487645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.488759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.488759] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('190c1749-3fb8-4199-b8e7-1ab227d2b30f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.489206] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.489639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.489961] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-44ad09c8-ee6b-4496-8939-cd6fba160843 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.490217] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.490453] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-45940cc3-3a03-4a7f-9cef-9063b50303f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.490570] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.813717] env[65102]: INFO networking_nsxv3.common.synchronization [req-a1289560-a386-47fe-a2da-9b7eee48b661 req-b3a1e21e-0e26-465d-970e-79923ae48c1c tempest-ServerMetadataTestJSON-1796680905 tempest-ServerMetadataTestJSON-1796680905-project-member] Enqueued Resource ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 with Priority: HIGHEST for action security_group_members [ 908.814426] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 with Priority: HIGHEST for action security_group_members [ 908.816067] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b55ab5c0-f0c2-4178-85f4-c461e1efe368 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.816067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.816067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.816067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.817175] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.817320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.817415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.817611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.817698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.817795] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b55ab5c0-f0c2-4178-85f4-c461e1efe368',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.945727] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.946744] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.947418] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45940cc3-3a03-4a7f-9cef-9063b50303f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.992211] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-45940cc3-3a03-4a7f-9cef-9063b50303f4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.992530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.992973] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 190c1749-3fb8-4199-b8e7-1ab227d2b30f with status ACTIVE [ 908.996025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.996025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.996025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.996025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.996025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.996025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.996025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.996025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.996025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.996025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.996025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.996025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.996025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.996025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.996025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.996025] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 190c1749-3fb8-4199-b8e7-1ab227d2b30f is going to be updated. [ 909.026082] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.026448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.026448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.026617] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.026910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.027220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-190c1749-3fb8-4199-b8e7-1ab227d2b30f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.092061] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: SUCCESS [ 909.093224] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.093568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.093600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.093707] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.138276] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 909.138276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.138276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.138276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.138721] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.301012] env[65102]: INFO networking_nsxv3.common.synchronization [req-afe8c808-8b87-44e5-ac7d-4d56a102fd96 req-cf2d74bc-b652-4b5f-85ca-2cdb605106a8 tempest-InstanceActionsV221TestJSON-2125704182 tempest-InstanceActionsV221TestJSON-2125704182-project-member] Enqueued Resource ID: 22827242-8721-47c3-af39-c8697770577f with Priority: HIGHEST for action security_group_members [ 909.301807] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22827242-8721-47c3-af39-c8697770577f with Priority: HIGHEST for action security_group_members [ 909.302175] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-22827242-8721-47c3-af39-c8697770577f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.302304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.302364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.302629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.302881] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.302993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.303074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.303229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.303315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.303561] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22827242-8721-47c3-af39-c8697770577f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.320760] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.320966] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.321039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.321235] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.321315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.321791] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.321791] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.321791] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.321962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.321962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.322030] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 is going to be updated. [ 909.367461] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.367654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.367809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.368022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.368234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.379931] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 in Status: IN_PROGRESS for 2s [ 909.453283] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.453283] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45940cc3-3a03-4a7f-9cef-9063b50303f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.453576] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.599155] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-44ad09c8-ee6b-4496-8939-cd6fba160843 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.599344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.641114] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.641519] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.805630] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.807755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.807952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.808203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.808300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.808534] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.808656] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.808719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.808875] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.808957] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.809055] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22827242-8721-47c3-af39-c8697770577f already deleted. [ 909.809145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.821896] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.822045] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-753" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.822220] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-753" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.822673] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-753" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.823118] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.823536] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.823683] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.824300] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.824300] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.824521] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 909.824707] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 909.824882] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 909.825270] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 909.825270] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 909.825426] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 909.826029] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 909.846894] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 909.847139] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 909.847344] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 909.847483] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-753" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.849453] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-3bd7ea5b-4f81-4cde-8a97-65795f27663e taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.849453] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-3bd7ea5b-4f81-4cde-8a97-65795f27663e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.849453] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-3bd7ea5b-4f81-4cde-8a97-65795f27663e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.849453] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-3bd7ea5b-4f81-4cde-8a97-65795f27663e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.849453] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bd7ea5b-4f81-4cde-8a97-65795f27663e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.936060] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 in Status: SUCCESS [ 909.936060] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 deletion is rescheduled due to dependency. [ 909.936060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.955882] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.956036] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.956215] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.956450] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.956596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.956746] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 is going to be updated. [ 909.958107] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.958394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.958394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.958635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.958781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.958935] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 is going to be created. [ 909.960224] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.960394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.960512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.960723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.960854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.961023] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 909.994531] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.994834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.994834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.995020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.995411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.001612] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.001612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.001612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.001612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.001612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.004390] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.004539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.004610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.004846] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.004984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.010134] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 in Status: UNINITIALIZED for 2s [ 910.014077] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 910.014882] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: IN_PROGRESS for 2s [ 910.353451] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.353451] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.353583] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.354240] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.354240] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.354358] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 3bd7ea5b-4f81-4cde-8a97-65795f27663e not found, creating... [ 910.354769] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.354908] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.355077] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.355642] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.355642] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.355906] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.355906] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.356157] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.356157] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.356392] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.356480] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 3bd7ea5b-4f81-4cde-8a97-65795f27663e is going to be created. [ 910.385398] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.386195] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.386195] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.386195] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.386360] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.386676] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-3bd7ea5b-4f81-4cde-8a97-65795f27663e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.126419] env[65102]: INFO networking_nsxv3.common.synchronization [req-afe8c808-8b87-44e5-ac7d-4d56a102fd96 req-052d3a21-9b6d-4e17-9695-376d9273bf1d service nova] Enqueued Resource ID: 22827242-8721-47c3-af39-c8697770577f with Priority: HIGHEST for action security_group_rules [ 911.126419] env[65102]: INFO networking_nsxv3.common.synchronization [req-afe8c808-8b87-44e5-ac7d-4d56a102fd96 req-052d3a21-9b6d-4e17-9695-376d9273bf1d service nova] Enqueued Resource ID: 22827242-8721-47c3-af39-c8697770577f with Priority: HIGHEST for action security_group_members [ 911.126796] env[65102]: INFO networking_nsxv3.common.synchronization [req-afe8c808-8b87-44e5-ac7d-4d56a102fd96 req-052d3a21-9b6d-4e17-9695-376d9273bf1d service nova] Enqueued Resource ID: 3bd7ea5b-4f81-4cde-8a97-65795f27663e with Priority: HIGHEST for action port [ 911.127402] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22827242-8721-47c3-af39-c8697770577f with Priority: HIGHEST for action security_group_rules [ 911.127402] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22827242-8721-47c3-af39-c8697770577f with Priority: HIGHEST for action security_group_members [ 911.127532] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd7ea5b-4f81-4cde-8a97-65795f27663e with Priority: HIGHEST for action port [ 911.128605] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22827242-8721-47c3-af39-c8697770577f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.128858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.128938] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.129323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.129587] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22827242-8721-47c3-af39-c8697770577f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.131057] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-22827242-8721-47c3-af39-c8697770577f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.131289] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.131405] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.131634] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.131934] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.133139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.133139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.133139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.133281] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.136621] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22827242-8721-47c3-af39-c8697770577f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.136621] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bd7ea5b-4f81-4cde-8a97-65795f27663e taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.136621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bd7ea5b-4f81-4cde-8a97-65795f27663e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.136621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bd7ea5b-4f81-4cde-8a97-65795f27663e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.136621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bd7ea5b-4f81-4cde-8a97-65795f27663e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.136621] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bd7ea5b-4f81-4cde-8a97-65795f27663e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.391669] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 in Status: SUCCESS [ 911.391669] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b55ab5c0-f0c2-4178-85f4-c461e1efe368 deletion is rescheduled due to dependency. [ 911.391669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b55ab5c0-f0c2-4178-85f4-c461e1efe368" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.637669] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-22827242-8721-47c3-af39-c8697770577f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.639741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.640388] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bd7ea5b-4f81-4cde-8a97-65795f27663e with status ACTIVE [ 911.640843] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.641122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.641308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.641654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.641876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.642374] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.642374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.645568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.645568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.645568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.645568] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.645568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.645568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.645568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.645568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.645568] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bd7ea5b-4f81-4cde-8a97-65795f27663e is going to be updated. [ 911.645568] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22827242-8721-47c3-af39-c8697770577f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.691141] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.691379] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.691477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.691823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.692109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.692385] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bd7ea5b-4f81-4cde-8a97-65795f27663e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.026811] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 in Status: SUCCESS [ 912.027380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.027481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.027701] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.028017] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.028113] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.028219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.028422] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.028583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.028719] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45940cc3-3a03-4a7f-9cef-9063b50303f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.032275] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: SUCCESS [ 912.032427] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.033499] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 912.033854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.034177] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.034617] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.036017] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.036017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.036017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.036017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.036017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.036017] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.037125] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.037678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.038174] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.038529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.038805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.039207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.039963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.039963] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.150387] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22827242-8721-47c3-af39-c8697770577f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.543195] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.544579] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45940cc3-3a03-4a7f-9cef-9063b50303f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.548960] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.655165] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.655513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.655653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.655896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.656034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.656201] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22827242-8721-47c3-af39-c8697770577f is going to be created. [ 912.685508] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.685797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.685797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.685929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.686158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.709220] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22827242-8721-47c3-af39-c8697770577f in Status: UNINITIALIZED for 2s [ 912.928479] env[65102]: INFO networking_nsxv3.common.synchronization [req-733e38f7-d410-4a1a-ad73-82fe4f0c5427 req-b69664ff-f3b4-46f2-b978-2cdc711f6a8f tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 912.928479] env[65102]: INFO networking_nsxv3.common.synchronization [req-733e38f7-d410-4a1a-ad73-82fe4f0c5427 req-b69664ff-f3b4-46f2-b978-2cdc711f6a8f tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 with Priority: HIGHEST for action security_group_members [ 912.928698] env[65102]: INFO networking_nsxv3.common.synchronization [req-733e38f7-d410-4a1a-ad73-82fe4f0c5427 req-b69664ff-f3b4-46f2-b978-2cdc711f6a8f tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGHEST for action security_group_members [ 912.929817] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 912.930029] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 with Priority: HIGHEST for action security_group_members [ 912.930149] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGHEST for action security_group_members [ 912.930478] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.930618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.930810] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-45940cc3-3a03-4a7f-9cef-9063b50303f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.930936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.931098] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-44ad09c8-ee6b-4496-8939-cd6fba160843 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.931170] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.048911] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.052298] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45940cc3-3a03-4a7f-9cef-9063b50303f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.056291] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.555673] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.556139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.556139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.556243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.556279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.556906] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 is going to be updated. [ 913.558508] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.558681] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.558787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.559053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.559571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.559651] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 is going to be updated. [ 913.561040] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.561213] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.561273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.561534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.561626] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.561751] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 913.605108] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.605334] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.605388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.605836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.605836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.608180] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.608317] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.608391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.608689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.608752] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.610640] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.610780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.610887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.615391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.615678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.633511] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 in Status: IN_PROGRESS for 2s [ 913.634636] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: IN_PROGRESS for 2s [ 913.635476] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 913.925659] env[65102]: INFO networking_nsxv3.common.synchronization [req-6c6372d8-7a98-4913-a1d8-ae3acd661af2 req-0dd0ebb3-b40d-403b-a01a-e0757673c01e tempest-ListServerFiltersTestJSON-1901090165 tempest-ListServerFiltersTestJSON-1901090165-project-member] Enqueued Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 913.926612] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 913.927838] env[65102]: INFO networking_nsxv3.common.synchronization [req-be0cc03b-44bb-4f24-a164-d0b893755b1b req-90e5469c-561a-4a37-93ac-1d299c042c95 tempest-ServerExternalEventsTest-2032441286 tempest-ServerExternalEventsTest-2032441286-project-member] Enqueued Resource ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef with Priority: HIGHEST for action security_group_members [ 913.931026] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.931141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.931184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.931371] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.931537] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.933099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.933201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.933563] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.933563] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.933677] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.937019] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef with Priority: HIGHEST for action security_group_members [ 913.937378] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1b926d4-3a35-4d53-823e-1d4fbac254ef taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.937498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.937567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.937750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.938449] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.938562] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.938633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.938793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.939231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.939414] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1b926d4-3a35-4d53-823e-1d4fbac254ef',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.344716] env[65102]: INFO networking_nsxv3.common.synchronization [req-d97c99d2-17f2-479f-90eb-b914abbd55e6 req-f82a7dd3-eeeb-44c8-946b-97037fbf3e22 tempest-AttachVolumeShelveTestJSON-733143698 tempest-AttachVolumeShelveTestJSON-733143698-project-member] Enqueued Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_members [ 914.345372] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_members [ 914.345693] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-01880e80-b093-4590-b2d1-b15567f49135 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.346028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.346100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.346364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.346789] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.346789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.346789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.346993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.346993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.346993] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.405357] env[65102]: INFO networking_nsxv3.common.synchronization [None req-d5b9a830-165e-4e7e-a80e-c3e29faf25de None None] Enqueued Resource ID: 94b51bae-148f-484e-96e8-b3febcdefa49 with Priority: HIGHEST for action port [ 914.405947] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94b51bae-148f-484e-96e8-b3febcdefa49 with Priority: HIGHEST for action port [ 914.407976] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-94b51bae-148f-484e-96e8-b3febcdefa49 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.408220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94b51bae-148f-484e-96e8-b3febcdefa49" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.408220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94b51bae-148f-484e-96e8-b3febcdefa49" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.408411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94b51bae-148f-484e-96e8-b3febcdefa49" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.408498] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94b51bae-148f-484e-96e8-b3febcdefa49',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.437309] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.442156] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.442156] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.442156] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.442358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.442358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.442556] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.442672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.442731] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.444037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.444037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.444037] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef is going to be updated. [ 914.478741] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.478741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.478741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.478741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.478741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.490055] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef in Status: IN_PROGRESS for 2s [ 914.720079] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22827242-8721-47c3-af39-c8697770577f in Status: SUCCESS [ 914.720449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.720506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.720707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.721116] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.721116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.721116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.721307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.721371] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.721461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.721558] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22827242-8721-47c3-af39-c8697770577f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.767332] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-500 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.767332] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.767332] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.767493] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.768168] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.768428] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.768991] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.768991] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.768991] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.769399] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 914.769555] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 914.769817] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 914.770080] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 914.770157] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 914.770273] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 914.771037] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 914.790816] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 914.791043] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 914.791230] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 914.791513] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.792027] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-b6bba8b1-799c-4c2b-bd94-8726094948ee taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.792489] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.792711] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.793169] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.794399] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6bba8b1-799c-4c2b-bd94-8726094948ee',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.850027] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.850187] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.850229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.850426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.850515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.850721] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.850855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.850855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.851039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.851107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.851194] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01880e80-b093-4590-b2d1-b15567f49135 already deleted. [ 914.851277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.912603] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94b51bae-148f-484e-96e8-b3febcdefa49 [ 914.912603] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.912603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.912603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.912603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.912603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.913075] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94b51bae-148f-484e-96e8-b3febcdefa49 already deleted. [ 914.913075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94b51bae-148f-484e-96e8-b3febcdefa49" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.939134] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.225844] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-22827242-8721-47c3-af39-c8697770577f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.225844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.225844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.225844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.225844] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.225844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.225844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.225844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.225844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.225844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.225844] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-22827242-8721-47c3-af39-c8697770577f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.225844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.225844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.226963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.227526] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.227842] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.229018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.229018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.229018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.229018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.229018] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22827242-8721-47c3-af39-c8697770577f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.300023] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.300023] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.300023] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.300023] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.300023] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.300023] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port b6bba8b1-799c-4c2b-bd94-8726094948ee not found, creating... [ 915.300023] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.300023] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.300023] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.300023] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.300023] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.300520] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.300520] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.300520] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.300520] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.300520] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.300753] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: b6bba8b1-799c-4c2b-bd94-8726094948ee is going to be created. [ 915.331037] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.331037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.331037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.331037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.331037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.331037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.442211] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.442211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.442211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.442420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.442420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.442585] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1966cd49-8e43-4ab8-862a-7f66af79660a is going to be updated. [ 915.480599] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.480759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.480863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.481145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.481311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.494153] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: IN_PROGRESS for 2s [ 915.649395] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 in Status: SUCCESS [ 915.649747] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.649789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.650057] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.650284] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.650407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.650475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.650647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.650730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.650817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.650965] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45940cc3-3a03-4a7f-9cef-9063b50303f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.652545] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: SUCCESS [ 915.652743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.653562] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 915.653739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.653921] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.654290] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.654388] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.654527] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.654605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.654775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.654880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.654973] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45940cc3-3a03-4a7f-9cef-9063b50303f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.655869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.656075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.656986] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.656986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.656986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.656986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.656986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.656986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.656986] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.657732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.658097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.658097] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.658270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.658270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.658401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.658504] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.658581] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.658651] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.660162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.660162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.660644] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.660644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.660644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.660644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.660804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.660804] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.662223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.662223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.662223] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.662223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.662223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.662599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.662599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.662599] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.732620] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22827242-8721-47c3-af39-c8697770577f: rpc.has_security_group_logging(os_id): False [ 915.752515] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.752661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.753633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.756996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.756996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.756996] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.756996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.756996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.756996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.756996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.758098] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.758291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.758341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.758503] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.758589] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.758807] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.758925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.758985] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.759135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.759221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.759313] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22827242-8721-47c3-af39-c8697770577f is going to be created. [ 915.835134] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.837415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.837415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.837415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.837415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.851423] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22827242-8721-47c3-af39-c8697770577f in Status: IN_PROGRESS for 2s [ 916.091446] env[65102]: INFO networking_nsxv3.common.synchronization [req-d97c99d2-17f2-479f-90eb-b914abbd55e6 req-d7f606f0-7d55-4f7a-a621-0dfbcfd13dd2 service nova] Enqueued Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_rules [ 916.091641] env[65102]: INFO networking_nsxv3.common.synchronization [req-d97c99d2-17f2-479f-90eb-b914abbd55e6 req-d7f606f0-7d55-4f7a-a621-0dfbcfd13dd2 service nova] Enqueued Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_members [ 916.091776] env[65102]: INFO networking_nsxv3.common.synchronization [req-d97c99d2-17f2-479f-90eb-b914abbd55e6 req-d7f606f0-7d55-4f7a-a621-0dfbcfd13dd2 service nova] Enqueued Resource ID: b6bba8b1-799c-4c2b-bd94-8726094948ee with Priority: HIGHEST for action port [ 916.092812] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_rules [ 916.093450] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_members [ 916.093684] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6bba8b1-799c-4c2b-bd94-8726094948ee with Priority: HIGHEST for action port [ 916.094205] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01880e80-b093-4590-b2d1-b15567f49135 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.094443] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.094713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.095049] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.095179] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.096643] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-01880e80-b093-4590-b2d1-b15567f49135 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.097282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.097428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.097698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.097933] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.098502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.098502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.098502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.098502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.098691] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.103534] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6bba8b1-799c-4c2b-bd94-8726094948ee taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.103534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.103534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.103534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.103534] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6bba8b1-799c-4c2b-bd94-8726094948ee',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.160803] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.161305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.161466] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.161828] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.162543] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.162882] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.163144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.163495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.163799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.164686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.164782] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 is going to be deleted. [ 916.166748] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45940cc3-3a03-4a7f-9cef-9063b50303f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.168504] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.170836] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.171012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.173237] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.173237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.173237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.173237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.173237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.173237] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.173237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.173237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.173687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.173687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.173687] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 is going to be updated. [ 916.175699] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.210278] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.210383] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.210417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.210781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.210901] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.211106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.212209] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.212363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.212415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.212630] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.212768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.226094] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: IN_PROGRESS for 2s [ 916.307369] env[65102]: INFO networking_nsxv3.common.synchronization [None req-a6782eeb-c7f9-4235-a528-43acd19036c9 None None] Enqueued Resource ID: 98eebf8c-3a02-4192-9e95-f5c736487304 with Priority: HIGHEST for action port [ 916.309691] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98eebf8c-3a02-4192-9e95-f5c736487304 with Priority: HIGHEST for action port [ 916.310240] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-98eebf8c-3a02-4192-9e95-f5c736487304 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.310240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98eebf8c-3a02-4192-9e95-f5c736487304" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.310240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98eebf8c-3a02-4192-9e95-f5c736487304" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.311051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98eebf8c-3a02-4192-9e95-f5c736487304" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.311051] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98eebf8c-3a02-4192-9e95-f5c736487304',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.503595] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef in Status: SUCCESS [ 916.503860] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1b926d4-3a35-4d53-823e-1d4fbac254ef deletion is rescheduled due to dependency. [ 916.504522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1b926d4-3a35-4d53-823e-1d4fbac254ef" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.605274] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-01880e80-b093-4590-b2d1-b15567f49135 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.605434] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.606170] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.606556] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6bba8b1-799c-4c2b-bd94-8726094948ee with status ACTIVE [ 916.606796] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.606871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.606914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.609028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.609028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.609028] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.609028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.609028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.609028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.609028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.609028] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.609028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.609028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.609028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.609028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.609028] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6bba8b1-799c-4c2b-bd94-8726094948ee is going to be updated. [ 916.647589] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.647589] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.647589] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.647853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.647853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.648023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.671421] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45940cc3-3a03-4a7f-9cef-9063b50303f4: rpc.has_security_group_logging(os_id): False [ 916.679586] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 44ad09c8-ee6b-4496-8939-cd6fba160843: rpc.has_security_group_logging(os_id): False [ 916.680704] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.693955] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.693955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.693955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.693955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.693955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.693955] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.693955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.693955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.693955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.693955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.693955] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 is going to be created. [ 916.704253] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.704392] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.704462] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.704668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.704751] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.704986] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.705107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.705167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.705317] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.705389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.705475] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 is going to be updated. [ 916.711824] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/45940cc3-3a03-4a7f-9cef-9063b50303f4], does not exist path=[/infra/domains/default/groups/45940cc3-3a03-4a7f-9cef-9063b50303f4]."\n}' [ 916.711989] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/45940cc3-3a03-4a7f-9cef-9063b50303f4 [ 916.712091] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 916.780191] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.780191] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.780191] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.780729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.783023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.783023] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.783023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.783023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.783462] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.783462] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.783564] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.783659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.783659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.787041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.787041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.787041] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45940cc3-3a03-4a7f-9cef-9063b50303f4 is going to be created. [ 916.803983] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.804149] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.804224] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.804654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.804755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.815086] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98eebf8c-3a02-4192-9e95-f5c736487304 [ 916.815086] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.815086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.815086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.815086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.815086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.815086] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98eebf8c-3a02-4192-9e95-f5c736487304 already deleted. [ 916.815086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98eebf8c-3a02-4192-9e95-f5c736487304" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.829421] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/45940cc3-3a03-4a7f-9cef-9063b50303f4], does not exist path=[/infra/domains/default/groups/45940cc3-3a03-4a7f-9cef-9063b50303f4]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/45940cc3-3a03-4a7f-9cef-9063b50303f4 [ 916.829622] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45940cc3-3a03-4a7f-9cef-9063b50303f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.832356] env[65102]: Traceback (most recent call last): [ 916.832356] env[65102]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 916.832356] env[65102]: return func(*args, **kwargs) [ 916.832356] env[65102]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 916.832356] env[65102]: res.raise_for_status() [ 916.832356] env[65102]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 916.832356] env[65102]: raise HTTPError(http_error_msg, response=self) [ 916.832356] env[65102]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/45940cc3-3a03-4a7f-9cef-9063b50303f4 [ 916.832356] env[65102]: During handling of the above exception, another exception occurred: [ 916.832356] env[65102]: Traceback (most recent call last): [ 916.832356] env[65102]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 916.832356] env[65102]: listener.cb(fileno) [ 916.832356] env[65102]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 916.832356] env[65102]: result = function(*args, **kwargs) [ 916.832356] env[65102]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 916.832356] env[65102]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 916.832356] env[65102]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 916.832356] env[65102]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 916.832356] env[65102]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 916.832356] env[65102]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 916.832356] env[65102]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 916.832356] env[65102]: res.raise_for_status() [ 916.832356] env[65102]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 916.832356] env[65102]: raise HTTPError(http_error_msg, response=self) [ 916.832356] env[65102]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/45940cc3-3a03-4a7f-9cef-9063b50303f4 [ 916.832356] env[65102]: Removing descriptor: 63 [ 916.840841] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: IN_PROGRESS for 2s [ 917.112407] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.188360] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.188530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.188593] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.188876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.188876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.188999] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 917.220762] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.220762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.220762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.220762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.221057] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.231197] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 917.505155] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: SUCCESS [ 917.505254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.617070] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.617266] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.617304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.618061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.618061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.618061] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01880e80-b093-4590-b2d1-b15567f49135 is going to be created. [ 917.656428] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.656588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.656651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.656867] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.657119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.669689] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01880e80-b093-4590-b2d1-b15567f49135 in Status: UNINITIALIZED for 2s [ 917.761216] env[65102]: INFO networking_nsxv3.common.synchronization [req-97b9ce9c-4102-4f70-bb1b-b7dada035584 req-09b72246-dead-4369-b1ee-07d0474144f7 tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGHEST for action security_group_members [ 917.761216] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGHEST for action security_group_members [ 917.762718] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-be29eb73-d99e-4af1-ad2e-c5ce871f7807 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.763091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.763317] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.763703] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.763988] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.764264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.764716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.766369] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.766369] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.766369] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be29eb73-d99e-4af1-ad2e-c5ce871f7807',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.868918] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22827242-8721-47c3-af39-c8697770577f in Status: SUCCESS [ 917.869442] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.185569] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.185762] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.185816] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.186077] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.186352] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.186515] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.186708] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.186856] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.187020] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.187265] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.187388] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.187505] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.187616] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.187730] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.187840] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.187998] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.211090] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.211090] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 918.211090] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.211090] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.211090] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-e5280424-9c40-4f31-a39e-260899363c1d taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.211779] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-e5280424-9c40-4f31-a39e-260899363c1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.211779] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-e5280424-9c40-4f31-a39e-260899363c1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.211779] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-e5280424-9c40-4f31-a39e-260899363c1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.211915] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5280424-9c40-4f31-a39e-260899363c1d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.236525] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: IN_PROGRESS for 4s [ 918.268032] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.269559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.269559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.269559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.269559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.269559] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.269559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.269559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.269559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.269559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.269559] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 already deleted. [ 918.269559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.714338] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.714599] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.714729] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.715041] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.715200] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.715374] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port e5280424-9c40-4f31-a39e-260899363c1d not found, creating... [ 918.715743] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.715911] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.716042] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.716273] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.716412] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.717027] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.717027] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.717634] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.717634] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.717634] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.717634] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: e5280424-9c40-4f31-a39e-260899363c1d is going to be created. [ 918.742517] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.742517] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.742517] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.742517] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.742517] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.742517] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-e5280424-9c40-4f31-a39e-260899363c1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.859601] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: SUCCESS [ 918.859601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.247026] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 919.247026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.247026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.247026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.247026] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.247026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.247026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.247026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.247026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.247026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.247026] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.247026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.247026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.247026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.247026] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.247932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.247932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.248656] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.248656] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.248656] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.248656] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.501599] env[65102]: INFO networking_nsxv3.common.synchronization [req-97b9ce9c-4102-4f70-bb1b-b7dada035584 req-a25cfad4-c8c7-4202-b4b0-ab1d19afce0c service nova] Enqueued Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGHEST for action security_group_rules [ 919.501711] env[65102]: INFO networking_nsxv3.common.synchronization [req-97b9ce9c-4102-4f70-bb1b-b7dada035584 req-a25cfad4-c8c7-4202-b4b0-ab1d19afce0c service nova] Enqueued Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGHEST for action security_group_members [ 919.501776] env[65102]: INFO networking_nsxv3.common.synchronization [req-97b9ce9c-4102-4f70-bb1b-b7dada035584 req-a25cfad4-c8c7-4202-b4b0-ab1d19afce0c service nova] Enqueued Resource ID: e5280424-9c40-4f31-a39e-260899363c1d with Priority: HIGHEST for action port [ 919.502351] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGHEST for action security_group_rules [ 919.502900] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGHEST for action security_group_members [ 919.503944] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5280424-9c40-4f31-a39e-260899363c1d with Priority: HIGHEST for action port [ 919.504347] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.504594] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.504594] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.504868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.504984] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be29eb73-d99e-4af1-ad2e-c5ce871f7807',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.506046] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-be29eb73-d99e-4af1-ad2e-c5ce871f7807 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.506182] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.506245] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.506452] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.507746] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.507746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.507746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.507746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.507746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.507746] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be29eb73-d99e-4af1-ad2e-c5ce871f7807',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.508129] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5280424-9c40-4f31-a39e-260899363c1d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.508270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5280424-9c40-4f31-a39e-260899363c1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.508333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5280424-9c40-4f31-a39e-260899363c1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.508534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5280424-9c40-4f31-a39e-260899363c1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.508645] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5280424-9c40-4f31-a39e-260899363c1d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.682219] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01880e80-b093-4590-b2d1-b15567f49135 in Status: SUCCESS [ 919.682219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.682219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.682504] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.682585] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.682709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.682774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.682951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.683380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.683569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.684424] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.751784] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for daef1b5a-f25a-405c-9f5a-58444ec5510f: rpc.has_security_group_logging(os_id): False [ 919.771142] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.771725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.771725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.771725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.805912] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.806368] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.806501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.806566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.806800] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.806887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.807150] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.807282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.807362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.807552] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.807649] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.808298] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.808298] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.808298] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.808470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.808470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.808569] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 919.901645] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.901943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.902254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.902590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.902832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.923563] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 920.011211] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be29eb73-d99e-4af1-ad2e-c5ce871f7807',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.012500] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-be29eb73-d99e-4af1-ad2e-c5ce871f7807 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.012654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.012718] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5280424-9c40-4f31-a39e-260899363c1d with status ACTIVE [ 920.012852] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.012969] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.013064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.013354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.013354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.013534] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.013618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.013618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.013856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.013973] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.015117] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.015221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.015325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.015487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.015530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.015667] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5280424-9c40-4f31-a39e-260899363c1d is going to be updated. [ 920.048097] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.048497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.048497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.048665] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.048883] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.049071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5280424-9c40-4f31-a39e-260899363c1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.187821] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.248429] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 in Status: SUCCESS [ 920.248429] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 deletion is rescheduled due to dependency. [ 920.248429] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.519661] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be29eb73-d99e-4af1-ad2e-c5ce871f7807',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.690595] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01880e80-b093-4590-b2d1-b15567f49135: rpc.has_security_group_logging(os_id): False [ 920.710025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.710025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.710025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.710025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.710025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.710025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.710025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.710025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.710025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.710025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.710440] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01880e80-b093-4590-b2d1-b15567f49135 is going to be created. [ 920.782501] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.782640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.782743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.783072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.783455] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.797652] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01880e80-b093-4590-b2d1-b15567f49135 in Status: IN_PROGRESS for 2s [ 921.021763] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.022042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.022122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.023209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.023209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.023209] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 is going to be created. [ 921.052541] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.053737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.053737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.053877] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.054142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.065257] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 in Status: UNINITIALIZED for 2s [ 921.635012] env[65102]: INFO networking_nsxv3.common.synchronization [req-53dd4a18-8746-4b87-badc-a512350cdcb1 req-ca9f1959-4a22-440d-8258-1b524d83f5d5 tempest-ServerDiskConfigTestJSON-1771527805 tempest-ServerDiskConfigTestJSON-1771527805-project-member] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 921.635409] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 921.635409] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.635501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.635546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.635841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.636052] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.636172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.636238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.636401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.636486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.636585] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.940856] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 921.941162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.963815] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-312 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.964030] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.964160] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.964484] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.964747] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.964904] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.965031] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.965250] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.965397] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.965662] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 921.965784] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 921.965899] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 921.966056] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 921.966180] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 921.966286] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 921.966443] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 921.984675] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 921.984898] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 921.985071] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 921.985258] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.985567] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-b58f1ae3-f99e-46a9-81be-e3d4925f3f85 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.985899] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-b58f1ae3-f99e-46a9-81be-e3d4925f3f85" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.986076] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-b58f1ae3-f99e-46a9-81be-e3d4925f3f85" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.986391] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-b58f1ae3-f99e-46a9-81be-e3d4925f3f85" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.986539] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b58f1ae3-f99e-46a9-81be-e3d4925f3f85',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.139760] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.139972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.140068] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.140328] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.140408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.140621] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.140741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.140807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.140971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.142208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.142311] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f already deleted. [ 922.142412] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.490233] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.490474] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.490602] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.490883] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.491045] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.491203] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port b58f1ae3-f99e-46a9-81be-e3d4925f3f85 not found, creating... [ 922.491497] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.491660] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.491775] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.491999] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.492151] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.492443] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.492596] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.492708] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.492907] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.493051] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.493190] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: b58f1ae3-f99e-46a9-81be-e3d4925f3f85 is going to be created. [ 922.517192] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.517439] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.517550] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.517852] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.518139] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.518376] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-b58f1ae3-f99e-46a9-81be-e3d4925f3f85" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.811466] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01880e80-b093-4590-b2d1-b15567f49135 in Status: SUCCESS [ 922.811839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.075592] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 in Status: SUCCESS [ 923.075949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.076147] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.076434] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.077056] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.077056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.077056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.077056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.077056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.077056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.077338] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be29eb73-d99e-4af1-ad2e-c5ce871f7807',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.264489] env[65102]: INFO networking_nsxv3.common.synchronization [req-53dd4a18-8746-4b87-badc-a512350cdcb1 req-fc4bd44e-5080-441b-a004-22282aeb9c35 service nova] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_rules [ 923.264489] env[65102]: INFO networking_nsxv3.common.synchronization [req-53dd4a18-8746-4b87-badc-a512350cdcb1 req-fc4bd44e-5080-441b-a004-22282aeb9c35 service nova] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 923.264489] env[65102]: INFO networking_nsxv3.common.synchronization [req-53dd4a18-8746-4b87-badc-a512350cdcb1 req-fc4bd44e-5080-441b-a004-22282aeb9c35 service nova] Enqueued Resource ID: b58f1ae3-f99e-46a9-81be-e3d4925f3f85 with Priority: HIGHEST for action port [ 923.264489] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_rules [ 923.266478] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 923.266478] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b58f1ae3-f99e-46a9-81be-e3d4925f3f85 with Priority: HIGHEST for action port [ 923.267599] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.267696] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.267748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.267996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.268102] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.269028] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.269147] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.269262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.269453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.269627] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.269726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.269787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.269960] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.270063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.270156] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.271085] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b58f1ae3-f99e-46a9-81be-e3d4925f3f85 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.271085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b58f1ae3-f99e-46a9-81be-e3d4925f3f85" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.271208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b58f1ae3-f99e-46a9-81be-e3d4925f3f85" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.271291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b58f1ae3-f99e-46a9-81be-e3d4925f3f85" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.271387] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b58f1ae3-f99e-46a9-81be-e3d4925f3f85',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.579146] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be29eb73-d99e-4af1-ad2e-c5ce871f7807',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.773988] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.774849] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.774978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.775776] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b58f1ae3-f99e-46a9-81be-e3d4925f3f85 with status ACTIVE [ 923.775776] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.775776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.775776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.776174] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.776174] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.776174] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.776378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.776378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.776680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.776763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.777035] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.777140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.777140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.778207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.778207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.778207] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b58f1ae3-f99e-46a9-81be-e3d4925f3f85 is going to be updated. [ 923.809473] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.809644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.809834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.810554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.810554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.810554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b58f1ae3-f99e-46a9-81be-e3d4925f3f85" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.928801] env[65102]: INFO networking_nsxv3.common.synchronization [req-4b98d868-dd77-48cd-bd45-6b6b1c16bd36 req-a8ab6fa7-bdb0-433f-ac0a-cdc4bf2210a0 tempest-InstanceActionsV221TestJSON-2125704182 tempest-InstanceActionsV221TestJSON-2125704182-project-member] Enqueued Resource ID: 22827242-8721-47c3-af39-c8697770577f with Priority: HIGHEST for action security_group_members [ 923.929392] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22827242-8721-47c3-af39-c8697770577f with Priority: HIGHEST for action security_group_members [ 923.929789] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-22827242-8721-47c3-af39-c8697770577f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.929919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.929919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.930177] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.930369] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.930602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.930602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.930787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.930918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.931054] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22827242-8721-47c3-af39-c8697770577f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.085668] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be29eb73-d99e-4af1-ad2e-c5ce871f7807: rpc.has_security_group_logging(os_id): False [ 924.104079] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.104239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.104310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.104578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.104682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.104928] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.105043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.105109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.105269] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.105346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.105435] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 is going to be created. [ 924.175483] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.175483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.175483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.175624] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.175678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.188157] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 in Status: IN_PROGRESS for 2s [ 924.280208] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.402379] env[65102]: INFO networking_nsxv3.common.synchronization [req-43248bfd-13ac-4bef-ad2e-c9b6c43d5936 req-5ec31af1-f42d-4855-bd55-636d29928d90 tempest-ServersNegativeTestMultiTenantJSON-1019907313 tempest-ServersNegativeTestMultiTenantJSON-1019907313-project-member] Enqueued Resource ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb with Priority: HIGHEST for action security_group_members [ 924.402967] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb with Priority: HIGHEST for action security_group_members [ 924.403335] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.403516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.403621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.403908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.404113] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.404349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.404446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.404628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.404746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.404869] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9e53d9-a7e1-4764-bc44-f35fa2308feb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.434014] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.435508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.435508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.435508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.463097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.463097] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.463297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.463401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.464239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.466048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.466048] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22827242-8721-47c3-af39-c8697770577f is going to be updated. [ 924.500667] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.500848] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.500889] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.501125] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.501272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.512627] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22827242-8721-47c3-af39-c8697770577f in Status: IN_PROGRESS for 2s [ 924.758669] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.759146] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-250" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.759296] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-250" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.759591] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-250" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.761753] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.761985] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.762050] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.762313] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.762458] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.762680] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.762790] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.762895] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.762998] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.763115] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.764391] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.764391] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.787025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.787025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.787025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.787025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.787025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.787025] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be created. [ 924.789938] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.790228] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 924.790373] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.790572] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-250" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.790915] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-205cebba-e381-4ab7-a1f5-c04561c1b7a3 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.791105] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-205cebba-e381-4ab7-a1f5-c04561c1b7a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.791243] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-205cebba-e381-4ab7-a1f5-c04561c1b7a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.791590] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-205cebba-e381-4ab7-a1f5-c04561c1b7a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.791762] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('205cebba-e381-4ab7-a1f5-c04561c1b7a3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.814946] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.814946] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.815139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.815393] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.815917] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.829525] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: UNINITIALIZED for 2s [ 924.907355] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.907711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.907711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.908013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.908171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.908433] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.908593] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.908699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.908927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.909069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.909221] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb already deleted. [ 924.909343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.295769] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.296160] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.296425] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.296652] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.296824] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.296957] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 205cebba-e381-4ab7-a1f5-c04561c1b7a3 not found, creating... [ 925.297357] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.297566] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.297631] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.297876] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.298413] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.298728] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.298912] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.299039] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.299265] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.299397] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.299537] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 205cebba-e381-4ab7-a1f5-c04561c1b7a3 is going to be created. [ 925.343985] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.344286] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.344436] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.344773] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.345114] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.345552] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-205cebba-e381-4ab7-a1f5-c04561c1b7a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.047095] env[65102]: INFO networking_nsxv3.common.synchronization [req-43248bfd-13ac-4bef-ad2e-c9b6c43d5936 req-fa310ce1-f5f9-469c-ab5b-34e2558091fb service nova] Enqueued Resource ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb with Priority: HIGHEST for action security_group_rules [ 926.047300] env[65102]: INFO networking_nsxv3.common.synchronization [req-43248bfd-13ac-4bef-ad2e-c9b6c43d5936 req-fa310ce1-f5f9-469c-ab5b-34e2558091fb service nova] Enqueued Resource ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb with Priority: HIGHEST for action security_group_members [ 926.047460] env[65102]: INFO networking_nsxv3.common.synchronization [req-43248bfd-13ac-4bef-ad2e-c9b6c43d5936 req-fa310ce1-f5f9-469c-ab5b-34e2558091fb service nova] Enqueued Resource ID: 205cebba-e381-4ab7-a1f5-c04561c1b7a3 with Priority: HIGHEST for action port [ 926.048643] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb with Priority: HIGHEST for action security_group_rules [ 926.048789] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb with Priority: HIGHEST for action security_group_members [ 926.048928] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 205cebba-e381-4ab7-a1f5-c04561c1b7a3 with Priority: HIGHEST for action port [ 926.049277] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad9e53d9-a7e1-4764-bc44-f35fa2308feb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.049420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.049477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.049783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.049886] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad9e53d9-a7e1-4764-bc44-f35fa2308feb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.056053] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.056221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.056389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.057345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.057580] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.057719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.057813] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.058024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.058150] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.058284] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9e53d9-a7e1-4764-bc44-f35fa2308feb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.059324] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-205cebba-e381-4ab7-a1f5-c04561c1b7a3 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.059462] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-205cebba-e381-4ab7-a1f5-c04561c1b7a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.059505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-205cebba-e381-4ab7-a1f5-c04561c1b7a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.060675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-205cebba-e381-4ab7-a1f5-c04561c1b7a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.060675] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('205cebba-e381-4ab7-a1f5-c04561c1b7a3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.200972] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 in Status: SUCCESS [ 926.200972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.529241] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22827242-8721-47c3-af39-c8697770577f in Status: SUCCESS [ 926.529643] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22827242-8721-47c3-af39-c8697770577f deletion is rescheduled due to dependency. [ 926.529643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.544040] env[65102]: INFO networking_nsxv3.common.synchronization [None req-bad81511-3996-4ff9-aa8d-068411bd47f2 tempest-ServerRescueNegativeTestJSON-286642771 tempest-ServerRescueNegativeTestJSON-286642771-project-member] Enqueued Resource ID: 5476d54c-8894-4aeb-b26c-f1637341e27f with Priority: HIGHEST for action security_group_rules [ 926.546495] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5476d54c-8894-4aeb-b26c-f1637341e27f with Priority: HIGHEST for action security_group_rules [ 926.547108] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5476d54c-8894-4aeb-b26c-f1637341e27f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.547534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.547534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.547611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.547696] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5476d54c-8894-4aeb-b26c-f1637341e27f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.561956] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad9e53d9-a7e1-4764-bc44-f35fa2308feb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.562558] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.562972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.563642] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 205cebba-e381-4ab7-a1f5-c04561c1b7a3 with status ACTIVE [ 926.563642] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.563770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.563770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.564761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.564761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.564761] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.564761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.564761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.564761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.565305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.565305] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.565305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.565305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.565449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.565544] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.565651] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 205cebba-e381-4ab7-a1f5-c04561c1b7a3 is going to be updated. [ 926.607367] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.607512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.607585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.607808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.607953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.608139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-205cebba-e381-4ab7-a1f5-c04561c1b7a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.648432] env[65102]: INFO networking_nsxv3.common.synchronization [None req-808007eb-fe36-4c2c-a410-03b22ed24488 tempest-ServerRescueNegativeTestJSON-286642771 tempest-ServerRescueNegativeTestJSON-286642771-project-member] Enqueued Resource ID: 5476d54c-8894-4aeb-b26c-f1637341e27f with Priority: HIGHEST for action security_group_rules [ 926.648982] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5476d54c-8894-4aeb-b26c-f1637341e27f with Priority: HIGHEST for action security_group_rules [ 926.649531] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5476d54c-8894-4aeb-b26c-f1637341e27f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.649531] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.841138] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 926.841365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.841587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.841807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.842053] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.842181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.842256] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.842408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.842489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.842576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.842684] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.066731] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad9e53d9-a7e1-4764-bc44-f35fa2308feb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.078964] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.078964] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.080139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.080139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.080139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.080139] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5476d54c-8894-4aeb-b26c-f1637341e27f already deleted. [ 927.080139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.080139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.080343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.080343] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5476d54c-8894-4aeb-b26c-f1637341e27f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.345580] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.345743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.345743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.345893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.346074] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.346175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.346238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.346409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.346497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.346583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.346729] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.346834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.346909] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.347070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.347212] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.347312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.347353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.347489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.347574] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.347947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.347947] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.570194] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.570478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.570573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.570873] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.571043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.571224] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb is going to be created. [ 927.596052] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.596214] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.596289] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.596511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.596749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.605976] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.606181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.606226] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.606429] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.607019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.607057] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5476d54c-8894-4aeb-b26c-f1637341e27f already deleted. [ 927.607129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.607837] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb in Status: UNINITIALIZED for 2s [ 927.849868] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a0c01bc-dc67-4824-bf8b-60c7f41f292f: rpc.has_security_group_logging(os_id): False [ 927.874987] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.875194] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.875295] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.875489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.875525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.875777] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.875884] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.875939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.876190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.876190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.876402] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.876498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.876561] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.876695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.876771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.876946] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.877049] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.877110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.877246] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.877319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.877404] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be created. [ 927.944951] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.945179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.945227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.945469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.945650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.959860] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 929.618822] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb in Status: SUCCESS [ 929.619182] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.619237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.619448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.619641] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.619761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.619823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.620022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.620074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.620142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.620233] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad9e53d9-a7e1-4764-bc44-f35fa2308feb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.973490] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 929.973490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.122416] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.123861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.123861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.123861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.123861] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.123861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.123861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.123861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.123861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.123861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.123861] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.124360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.124360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.124360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.124457] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.124553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.124587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.124810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.124939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.125181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.125288] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad9e53d9-a7e1-4764-bc44-f35fa2308feb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.628061] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad9e53d9-a7e1-4764-bc44-f35fa2308feb: rpc.has_security_group_logging(os_id): False [ 930.651121] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.651295] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.651397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.651670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.651868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.652168] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.652298] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.652366] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.652680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.652832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.653217] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.653546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.653620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.654319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.654409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.654637] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.654834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.655341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.655341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.655341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.655341] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb is going to be created. [ 930.737498] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.737668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.737795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.738045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.738438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.750728] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb in Status: IN_PROGRESS for 2s [ 931.650146] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 931.650465] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 932.765379] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb in Status: SUCCESS [ 932.765700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.651441] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 936.651814] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 937.360319] env[65102]: INFO networking_nsxv3.common.synchronization [None req-8c564306-b235-41d0-a7fe-d05f4e42a8e8 None None] Enqueued Resource ID: bfec604d-a864-463b-99d5-a98a3dda09d9 with Priority: HIGHEST for action port [ 937.361387] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfec604d-a864-463b-99d5-a98a3dda09d9 with Priority: HIGHEST for action port [ 937.361387] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfec604d-a864-463b-99d5-a98a3dda09d9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.361387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfec604d-a864-463b-99d5-a98a3dda09d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.361387] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfec604d-a864-463b-99d5-a98a3dda09d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.362770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfec604d-a864-463b-99d5-a98a3dda09d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.364315] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfec604d-a864-463b-99d5-a98a3dda09d9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.828063] env[65102]: INFO networking_nsxv3.common.synchronization [req-fe8fbf0c-253f-4536-bb0e-6302d78a65f1 req-49225b1a-b770-4f9a-b0a7-c3b7e9a740df tempest-ServersAdminNegativeTestJSON-1381091624 tempest-ServersAdminNegativeTestJSON-1381091624-project-member] Enqueued Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_members [ 937.828603] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_members [ 937.828741] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.828885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.828956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.829678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.829678] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.829678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.829678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.829678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.829965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.829965] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.868408] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bfec604d-a864-463b-99d5-a98a3dda09d9 [ 937.868738] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.868881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.868951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.869190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.869285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.869379] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bfec604d-a864-463b-99d5-a98a3dda09d9 already deleted. [ 937.869461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfec604d-a864-463b-99d5-a98a3dda09d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.167918] env[65102]: INFO networking_nsxv3.common.synchronization [req-e9028fbe-049e-4254-bcac-c099b5c79187 req-bd91c03f-d513-498d-ad8a-c5cc044aed82 tempest-ServersNegativeTestMultiTenantJSON-1019907313 tempest-ServersNegativeTestMultiTenantJSON-1019907313-project-member] Enqueued Resource ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb with Priority: HIGHEST for action security_group_members [ 938.167918] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb with Priority: HIGHEST for action security_group_members [ 938.167918] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.167918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.168216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.168979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.168979] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.168979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.168979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.168979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.168979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.168979] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad9e53d9-a7e1-4764-bc44-f35fa2308feb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.263502] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.263715] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.263841] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.265058] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.265058] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.265058] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.265058] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.265058] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.265415] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.269030] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.269030] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.269030] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.269030] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.269030] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.269030] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.269030] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.287702] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.287970] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 938.288063] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.288242] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.288602] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-dacbb269-1799-4b10-8007-7778dddae890 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.288798] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-dacbb269-1799-4b10-8007-7778dddae890" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.288916] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-dacbb269-1799-4b10-8007-7778dddae890" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.289272] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-dacbb269-1799-4b10-8007-7778dddae890" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.289411] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dacbb269-1799-4b10-8007-7778dddae890',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.332450] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.332603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.332657] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.332833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.332924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.333132] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.333225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.333284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.333435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.333509] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.333594] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd79c243-92bc-47a2-80ad-114091c4bab9 already deleted. [ 938.333678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.670825] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.670961] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.671039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.671283] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.671374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.671590] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.671706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.671767] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.671909] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.672027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.672073] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb is going to be updated. [ 938.710705] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.710705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.710705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.710959] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.711102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.724811] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb in Status: IN_PROGRESS for 2s [ 938.794245] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.794883] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.798060] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.798060] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.798060] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.798060] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port dacbb269-1799-4b10-8007-7778dddae890 not found, creating... [ 938.798060] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.798060] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.798060] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.798060] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.798642] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.798642] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.798937] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.799024] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.799234] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.799387] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.799867] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: dacbb269-1799-4b10-8007-7778dddae890 is going to be created. [ 938.829396] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.829396] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.829396] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.829396] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.829396] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.831603] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-dacbb269-1799-4b10-8007-7778dddae890" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.591716] env[65102]: INFO networking_nsxv3.common.synchronization [req-fe8fbf0c-253f-4536-bb0e-6302d78a65f1 req-af64259e-bbbc-4f2b-b094-f56ea3021218 service nova] Enqueued Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_rules [ 939.591803] env[65102]: INFO networking_nsxv3.common.synchronization [req-fe8fbf0c-253f-4536-bb0e-6302d78a65f1 req-af64259e-bbbc-4f2b-b094-f56ea3021218 service nova] Enqueued Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_members [ 939.591920] env[65102]: INFO networking_nsxv3.common.synchronization [req-fe8fbf0c-253f-4536-bb0e-6302d78a65f1 req-af64259e-bbbc-4f2b-b094-f56ea3021218 service nova] Enqueued Resource ID: dacbb269-1799-4b10-8007-7778dddae890 with Priority: HIGHEST for action port [ 939.592543] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_rules [ 939.592740] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_members [ 939.592816] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dacbb269-1799-4b10-8007-7778dddae890 with Priority: HIGHEST for action port [ 939.594074] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.594314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.594438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.595185] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.596461] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.597779] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.597779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.597779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.598139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.598198] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.598311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.598395] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.598648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.599181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.599181] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.600053] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-dacbb269-1799-4b10-8007-7778dddae890 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.600145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dacbb269-1799-4b10-8007-7778dddae890" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.600218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dacbb269-1799-4b10-8007-7778dddae890" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.600474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dacbb269-1799-4b10-8007-7778dddae890" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.601203] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dacbb269-1799-4b10-8007-7778dddae890',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.799061] env[65102]: INFO networking_nsxv3.common.synchronization [None req-be7ecef2-b700-4f6d-aad3-0cb88c69bb00 None None] Enqueued Resource ID: 78a768c3-82f0-4283-afa0-5862f73be55e with Priority: HIGHEST for action port [ 939.799448] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a768c3-82f0-4283-afa0-5862f73be55e with Priority: HIGHEST for action port [ 939.799767] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-78a768c3-82f0-4283-afa0-5862f73be55e taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.799894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78a768c3-82f0-4283-afa0-5862f73be55e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.799963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78a768c3-82f0-4283-afa0-5862f73be55e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.800238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78a768c3-82f0-4283-afa0-5862f73be55e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.800323] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78a768c3-82f0-4283-afa0-5862f73be55e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.040471] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb6b1386-b2da-4655-9886-95af158110b3 req-2ad4b6e4-6e5f-4922-8026-f8a27efb5793 tempest-ServerActionsTestOtherB-1046242315 tempest-ServerActionsTestOtherB-1046242315-project-member] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 940.041512] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 940.041512] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.041667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.041667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.042065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.042136] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.042410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.042410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.042491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.042573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.042755] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.106073] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.106073] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.106073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.106073] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dacbb269-1799-4b10-8007-7778dddae890 with status ACTIVE [ 940.106073] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.106073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.106073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.106073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.106073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.106073] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.107057] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.107252] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.107575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.107788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.108160] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.108478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.108712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.109053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.109258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.109503] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dacbb269-1799-4b10-8007-7778dddae890 is going to be updated. [ 940.133335] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.133539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.133539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.135022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.135022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.135022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dacbb269-1799-4b10-8007-7778dddae890" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.304740] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78a768c3-82f0-4283-afa0-5862f73be55e [ 940.305025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.308033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.308033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.308033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.308033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.308033] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78a768c3-82f0-4283-afa0-5862f73be55e already deleted. [ 940.308033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78a768c3-82f0-4283-afa0-5862f73be55e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.545993] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.546177] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.546248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.546499] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.574304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.574737] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.575066] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.575066] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.575170] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.575218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.575313] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be updated. [ 940.602480] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.602683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.602683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.602962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.603122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.611966] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: IN_PROGRESS for 2s [ 940.612200] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.737030] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb in Status: SUCCESS [ 940.737148] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb deletion is rescheduled due to dependency. [ 940.737239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.795884] env[65102]: INFO networking_nsxv3.common.synchronization [req-eb21569a-d821-4fd7-8c3b-e63a6a4a123a req-8d425381-b81f-4689-a4de-2206275fc286 tempest-ServersTestFqdnHostnames-624065465 tempest-ServersTestFqdnHostnames-624065465-project-member] Enqueued Resource ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 with Priority: HIGHEST for action security_group_members [ 940.796772] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 with Priority: HIGHEST for action security_group_members [ 940.796868] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bf5a5e9-3448-461d-8616-ceb9cef4d902 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.796927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.796960] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.797359] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.797573] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.797748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.797844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.798151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.798265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.798396] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bf5a5e9-3448-461d-8616-ceb9cef4d902',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.118142] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.118489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.118489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.118976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.119167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.119431] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd79c243-92bc-47a2-80ad-114091c4bab9 is going to be created. [ 941.149428] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.149752] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.149959] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.150332] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.150663] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.162901] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: UNINITIALIZED for 2s [ 941.301053] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.301053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.301053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.301053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.341486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.342194] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.342194] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.342194] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.342429] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.342514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.342743] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 is going to be updated. [ 941.386573] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.386763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.386836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.387062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.387205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.402814] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 in Status: IN_PROGRESS for 2s [ 941.737143] env[65102]: INFO networking_nsxv3.common.synchronization [req-5e44cd89-2ccd-48d0-aa94-1df4ff9e2d14 req-c8b30838-0721-466a-85dd-1969b4b9b167 tempest-DeleteServersTestJSON-1773899535 tempest-DeleteServersTestJSON-1773899535-project-member] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 941.738061] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 941.738467] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.738624] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.738842] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.738944] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.739132] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.739398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.739398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.739493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.739573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.739678] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.209437] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.209785] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.209876] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.210267] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.210621] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.210878] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.211064] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.211383] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.211681] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.211806] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.211950] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.212121] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.212251] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.212404] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.212543] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.212716] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.236548] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.236742] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 942.236888] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.237232] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.237406] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-1c2c4d44-fde7-4882-9b77-f18455fd3786 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.237580] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-1c2c4d44-fde7-4882-9b77-f18455fd3786" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.237701] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-1c2c4d44-fde7-4882-9b77-f18455fd3786" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.238049] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-1c2c4d44-fde7-4882-9b77-f18455fd3786" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.238196] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c2c4d44-fde7-4882-9b77-f18455fd3786',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.242192] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.242367] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.242532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.242585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.274624] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.275106] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.275106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.275106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.275297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.275447] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.275737] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 942.306657] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.306933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.307127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.307259] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.307435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.322805] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 942.622299] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 942.622512] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 deletion is rescheduled due to dependency. [ 942.622627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.742116] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.742401] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.742715] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.743114] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.743364] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.743469] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 1c2c4d44-fde7-4882-9b77-f18455fd3786 not found, creating... [ 942.743832] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.744121] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.744173] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.744487] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.744596] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.744920] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.745143] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.745288] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.745553] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.745698] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.745843] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 1c2c4d44-fde7-4882-9b77-f18455fd3786 is going to be created. [ 942.767610] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.767833] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.767960] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.768270] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.768500] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.768728] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-1c2c4d44-fde7-4882-9b77-f18455fd3786" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.173871] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: SUCCESS [ 943.174112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.174268] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.174537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.174732] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.174849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.174918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.175097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.175221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.175315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.175423] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.413131] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 in Status: SUCCESS [ 943.413417] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 deletion is rescheduled due to dependency. [ 943.413518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.500079] env[65102]: INFO networking_nsxv3.common.synchronization [req-5e44cd89-2ccd-48d0-aa94-1df4ff9e2d14 req-b4e85e33-79c2-4495-9650-099a8f7a13cb service nova] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_rules [ 943.500772] env[65102]: INFO networking_nsxv3.common.synchronization [req-5e44cd89-2ccd-48d0-aa94-1df4ff9e2d14 req-b4e85e33-79c2-4495-9650-099a8f7a13cb service nova] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 943.501130] env[65102]: INFO networking_nsxv3.common.synchronization [req-5e44cd89-2ccd-48d0-aa94-1df4ff9e2d14 req-b4e85e33-79c2-4495-9650-099a8f7a13cb service nova] Enqueued Resource ID: 1c2c4d44-fde7-4882-9b77-f18455fd3786 with Priority: HIGHEST for action port [ 943.501889] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_rules [ 943.502174] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 943.503432] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c2c4d44-fde7-4882-9b77-f18455fd3786 with Priority: HIGHEST for action port [ 943.505043] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.505330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.505705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.506030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.506203] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.508344] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.508344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.508344] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c2c4d44-fde7-4882-9b77-f18455fd3786 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.508344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c2c4d44-fde7-4882-9b77-f18455fd3786" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.508344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c2c4d44-fde7-4882-9b77-f18455fd3786" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.508609] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c2c4d44-fde7-4882-9b77-f18455fd3786" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.508609] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c2c4d44-fde7-4882-9b77-f18455fd3786',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.680277] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.680277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.680277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.680277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.680277] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.680277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.680277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.680277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.680277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.680277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.680277] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.680277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.680277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.680277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.680277] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.680277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.681426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.681426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.681426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.681426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.681426] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.010882] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.010882] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.011092] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c2c4d44-fde7-4882-9b77-f18455fd3786 with status ACTIVE [ 944.011264] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.011373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.011491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.011635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.011725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.011891] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.011983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.012056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.012212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.012287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.012471] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.012582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.012645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.012780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.012853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.012936] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c2c4d44-fde7-4882-9b77-f18455fd3786 is going to be updated. [ 944.044885] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.045050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.045126] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.045339] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.046035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.046223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c2c4d44-fde7-4882-9b77-f18455fd3786" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.186571] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd79c243-92bc-47a2-80ad-114091c4bab9: rpc.has_security_group_logging(os_id): False [ 944.214180] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.214180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.214180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.214180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.214180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.214180] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.214180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.214180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.214180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.214180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.214180] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.214180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.214180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.214180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.214180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.214821] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.214821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.214821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.214821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.214821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.214821] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd79c243-92bc-47a2-80ad-114091c4bab9 is going to be created. [ 944.295307] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.295307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.295307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.295307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.295307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.307871] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: IN_PROGRESS for 2s [ 944.323627] env[65102]: INFO networking_nsxv3.common.synchronization [req-4d723e27-f208-4a02-bb4c-31bf80953c99 req-b46c4ed4-9a2f-434d-b321-2567f887a242 tempest-InstanceActionsNegativeTestJSON-930462260 tempest-InstanceActionsNegativeTestJSON-930462260-project-member] Enqueued Resource ID: cef9ee3d-68cd-4411-ad09-df35823eb076 with Priority: HIGHEST for action security_group_members [ 944.326226] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef9ee3d-68cd-4411-ad09-df35823eb076 with Priority: HIGHEST for action security_group_members [ 944.327410] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-cef9ee3d-68cd-4411-ad09-df35823eb076 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.327926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.328164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.328575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.328916] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.329694] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.329694] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.329871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.330012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.330162] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cef9ee3d-68cd-4411-ad09-df35823eb076',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.339825] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 944.340117] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f deletion is rescheduled due to dependency. [ 944.340262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.340414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.340928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.344949] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.344949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.344949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.344949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.344949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.344949] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.685661] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-813 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.686147] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-813" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.686400] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-813" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.686850] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-813" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.687143] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.687318] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.687441] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.687686] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.687823] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.688046] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.688162] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.688271] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.688378] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.688487] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.688607] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.688994] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.708364] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.708562] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 944.708707] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.708892] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-813" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.710261] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.710261] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.710261] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.710261] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.710261] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.835476] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.835732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.835807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.836153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.836153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.836382] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.836488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.836554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.836754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.837772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.837772] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cef9ee3d-68cd-4411-ad09-df35823eb076 already deleted. [ 944.837772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.846608] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.215261] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.215545] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.215696] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.216030] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.216254] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.216453] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6 not found, creating... [ 945.216842] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.217117] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.217248] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.217588] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.217780] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.218140] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.218321] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.218464] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.218694] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.218901] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.219143] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6 is going to be created. [ 945.246345] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.246685] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.246905] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.247314] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.247824] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.248094] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.350509] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.854043] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.854043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.854043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.854571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.854571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.854571] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 945.889262] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.889476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.889542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.889798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.890017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.901710] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 946.017252] env[65102]: INFO networking_nsxv3.common.synchronization [req-4d723e27-f208-4a02-bb4c-31bf80953c99 req-3aac633e-6958-4b57-8c90-48c1bde37492 service nova] Enqueued Resource ID: cef9ee3d-68cd-4411-ad09-df35823eb076 with Priority: HIGHEST for action security_group_rules [ 946.017252] env[65102]: INFO networking_nsxv3.common.synchronization [req-4d723e27-f208-4a02-bb4c-31bf80953c99 req-3aac633e-6958-4b57-8c90-48c1bde37492 service nova] Enqueued Resource ID: cef9ee3d-68cd-4411-ad09-df35823eb076 with Priority: HIGHEST for action security_group_members [ 946.017252] env[65102]: INFO networking_nsxv3.common.synchronization [req-4d723e27-f208-4a02-bb4c-31bf80953c99 req-3aac633e-6958-4b57-8c90-48c1bde37492 service nova] Enqueued Resource ID: c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6 with Priority: HIGHEST for action port [ 946.017697] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef9ee3d-68cd-4411-ad09-df35823eb076 with Priority: HIGHEST for action security_group_rules [ 946.017838] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef9ee3d-68cd-4411-ad09-df35823eb076 with Priority: HIGHEST for action security_group_members [ 946.017956] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6 with Priority: HIGHEST for action port [ 946.018239] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cef9ee3d-68cd-4411-ad09-df35823eb076 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.018347] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.018414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.018716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.018782] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cef9ee3d-68cd-4411-ad09-df35823eb076',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.019659] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-cef9ee3d-68cd-4411-ad09-df35823eb076 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.020673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.020673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.020673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.020673] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.020673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.020673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.020673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.021227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.021227] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cef9ee3d-68cd-4411-ad09-df35823eb076',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.021657] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.021758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.021830] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.022046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.023176] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.324419] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: SUCCESS [ 946.325697] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.440401] env[65102]: INFO networking_nsxv3.common.synchronization [req-3a4d5600-00b1-4088-83b6-e84cea78f0c0 req-e3c5806b-bf2a-462b-aecc-e8458fd3629f tempest-ListServerFiltersTestJSON-1901090165 tempest-ListServerFiltersTestJSON-1901090165-project-member] Enqueued Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 946.441516] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1966cd49-8e43-4ab8-862a-7f66af79660a with Priority: HIGHEST for action security_group_members [ 946.441516] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-1966cd49-8e43-4ab8-862a-7f66af79660a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.441754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.441754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.441868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.441979] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.442084] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.442152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.442293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.442384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.442494] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1966cd49-8e43-4ab8-862a-7f66af79660a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.525439] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cef9ee3d-68cd-4411-ad09-df35823eb076',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.526486] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-cef9ee3d-68cd-4411-ad09-df35823eb076 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.526644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.526748] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6 with status ACTIVE [ 946.526905] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.527027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.527117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.527290] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.527376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.527543] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.527638] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.527712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.527890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.527939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.528147] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.528239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.528300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.528435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.528508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.528591] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6 is going to be updated. [ 946.555872] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.556114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.556232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.558474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.558474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.558474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8e399f8-2c17-4218-97fe-e9f1a1ad2eb6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.906813] env[65102]: INFO networking_nsxv3.common.synchronization [req-20dabf20-901f-4fa2-9b79-cccae7df58f8 req-76fd9d8a-d7d2-462c-87fd-a35042648fe8 tempest-ImagesTestJSON-2026451637 tempest-ImagesTestJSON-2026451637-project-member] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 946.907989] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 946.907989] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.908270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.908270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.908571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.908662] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.908890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.908890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.909091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.909205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.909326] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.945179] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.945527] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.945618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.946052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.974854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.974854] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.974854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.974854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.974854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.974854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.974854] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1966cd49-8e43-4ab8-862a-7f66af79660a is going to be updated. [ 947.003760] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.003927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.004010] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.004229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.004374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.013579] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: IN_PROGRESS for 2s [ 947.032812] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cef9ee3d-68cd-4411-ad09-df35823eb076',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.360020] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.360020] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.360020] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.360020] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.360020] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.360020] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.360020] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.360020] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.360652] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.361024] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.361276] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.361512] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.361737] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.364266] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.364266] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.364266] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.386452] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.388848] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 947.388848] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.388848] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.388848] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-853b4d7e-c8ee-4570-a59c-310c21f06168 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.388848] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-853b4d7e-c8ee-4570-a59c-310c21f06168" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.388848] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-853b4d7e-c8ee-4570-a59c-310c21f06168" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.389537] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-853b4d7e-c8ee-4570-a59c-310c21f06168" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.389847] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('853b4d7e-c8ee-4570-a59c-310c21f06168',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.412221] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.539423] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.539423] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.539423] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.539423] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.539423] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.539423] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cef9ee3d-68cd-4411-ad09-df35823eb076 is going to be created. [ 947.563033] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.565910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.565910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.565910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.565910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.574992] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cef9ee3d-68cd-4411-ad09-df35823eb076 in Status: UNINITIALIZED for 2s [ 947.769255] env[65102]: INFO networking_nsxv3.common.synchronization [None req-425385cf-be9b-4aaf-8bcd-7196482cd48b None None] Enqueued Resource ID: f82fb178-4005-4729-b722-7c7ab3535bbb with Priority: HIGHEST for action port [ 947.771051] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f82fb178-4005-4729-b722-7c7ab3535bbb with Priority: HIGHEST for action port [ 947.771591] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-f82fb178-4005-4729-b722-7c7ab3535bbb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.773483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f82fb178-4005-4729-b722-7c7ab3535bbb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.773483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f82fb178-4005-4729-b722-7c7ab3535bbb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.773483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f82fb178-4005-4729-b722-7c7ab3535bbb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.773483] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f82fb178-4005-4729-b722-7c7ab3535bbb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.897026] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.897026] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.897026] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.897026] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.897026] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.897026] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 853b4d7e-c8ee-4570-a59c-310c21f06168 not found, creating... [ 947.897026] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.897026] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.897026] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.897026] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.897026] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.897507] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.897507] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.897507] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.897507] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.897507] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.897507] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 853b4d7e-c8ee-4570-a59c-310c21f06168 is going to be created. [ 947.914024] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 947.914024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.914024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.914024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.914024] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.914024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.914024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.914024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.914024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.914024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.914024] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.914024] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.920206] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.920406] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.920527] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.920777] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.920997] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.921233] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-853b4d7e-c8ee-4570-a59c-310c21f06168" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.274900] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f82fb178-4005-4729-b722-7c7ab3535bbb [ 948.274900] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.275155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.275155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.275768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.275768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.275768] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f82fb178-4005-4729-b722-7c7ab3535bbb already deleted. [ 948.275768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f82fb178-4005-4729-b722-7c7ab3535bbb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.414623] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.414843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.414889] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.415180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.415269] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.415374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.415438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.415590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.415675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.415766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.415915] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.416016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.416078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.416243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.416359] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.416450] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.416510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.416646] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.416720] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.416801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.416891] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.422393] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.422488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.422556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.422720] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.422812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.422906] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be updated. [ 948.458666] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.458981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.460086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.460086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.460086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.474877] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 948.921409] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99c8f96e-2cdb-49cd-8847-bf7698ff539f: rpc.has_security_group_logging(os_id): False [ 948.939566] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.939566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.939566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.941097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.941097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.941097] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.941097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.941097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.941097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.941097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.941097] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.941097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.941097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.941097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.941097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.941869] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.941869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.941869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.941869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.941869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.941869] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 949.005744] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.005953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.007551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.008127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.008300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.030177] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1966cd49-8e43-4ab8-862a-7f66af79660a in Status: SUCCESS [ 949.030481] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1966cd49-8e43-4ab8-862a-7f66af79660a deletion is rescheduled due to dependency. [ 949.030616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1966cd49-8e43-4ab8-862a-7f66af79660a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.042105] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 949.071524] env[65102]: INFO networking_nsxv3.common.synchronization [req-e0b4f7ac-b806-495e-b7e8-c7964fdee0da req-396e85cc-7ca1-4b6e-822e-5fa8a0246bb9 tempest-ServerDiskConfigTestJSON-1771527805 tempest-ServerDiskConfigTestJSON-1771527805-project-member] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 949.072160] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 949.072487] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.072612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.074056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.074056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.074056] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.074282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.074282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.076663] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.076663] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.076663] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.177286] env[65102]: INFO networking_nsxv3.common.synchronization [req-20dabf20-901f-4fa2-9b79-cccae7df58f8 req-ed884b3b-e522-462f-87dc-382abd3ce9aa service nova] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_rules [ 949.177506] env[65102]: INFO networking_nsxv3.common.synchronization [req-20dabf20-901f-4fa2-9b79-cccae7df58f8 req-ed884b3b-e522-462f-87dc-382abd3ce9aa service nova] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 949.177671] env[65102]: INFO networking_nsxv3.common.synchronization [req-20dabf20-901f-4fa2-9b79-cccae7df58f8 req-ed884b3b-e522-462f-87dc-382abd3ce9aa service nova] Enqueued Resource ID: 853b4d7e-c8ee-4570-a59c-310c21f06168 with Priority: HIGHEST for action port [ 949.178296] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_rules [ 949.178523] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 949.178570] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 853b4d7e-c8ee-4570-a59c-310c21f06168 with Priority: HIGHEST for action port [ 949.178896] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.178989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.179326] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.179588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.179707] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.181595] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.181730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.182027] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-853b4d7e-c8ee-4570-a59c-310c21f06168 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.182200] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-853b4d7e-c8ee-4570-a59c-310c21f06168" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.182300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-853b4d7e-c8ee-4570-a59c-310c21f06168" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.182625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-853b4d7e-c8ee-4570-a59c-310c21f06168" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.182860] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('853b4d7e-c8ee-4570-a59c-310c21f06168',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.578316] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.578586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.578849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.579395] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.579395] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.579543] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.579695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.579805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.580095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.580265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.580435] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 949.594573] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cef9ee3d-68cd-4411-ad09-df35823eb076 in Status: SUCCESS [ 949.594573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.595287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.595502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.595792] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.595919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.596829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.598848] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.598848] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.598848] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.598848] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cef9ee3d-68cd-4411-ad09-df35823eb076',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.614663] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.614992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.614992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.619616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.619616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.631862] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 949.685290] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 853b4d7e-c8ee-4570-a59c-310c21f06168 with status ACTIVE [ 949.685727] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.687378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.687505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.687741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.687840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.688089] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.688219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.688286] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.688463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.688544] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.688763] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.688861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.688925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.689119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.689193] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.689277] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 853b4d7e-c8ee-4570-a59c-310c21f06168 is going to be updated. [ 949.690422] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.690676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.713586] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.713719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.713758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.713947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.714101] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.714254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-853b4d7e-c8ee-4570-a59c-310c21f06168" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.741737] env[65102]: INFO networking_nsxv3.common.synchronization [None req-53ef5421-a29a-455c-ac25-24368a7b3b02 tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_rules [ 949.742548] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_rules [ 949.742913] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.743109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.744047] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.744047] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.744047] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.860187] env[65102]: INFO networking_nsxv3.common.synchronization [None req-f0ef617b-e0d8-4ed0-a078-49f59af9cec2 tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_rules [ 949.861334] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_rules [ 949.861334] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.861334] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.084255] env[65102]: INFO networking_nsxv3.common.synchronization [None req-b92d8222-8073-4671-9553-7a7064a8f26a None None] Enqueued Resource ID: f0a01dc2-e3e1-4159-977a-8dab10ff300d with Priority: HIGHEST for action port [ 950.084907] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0a01dc2-e3e1-4159-977a-8dab10ff300d with Priority: HIGHEST for action port [ 950.086280] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0a01dc2-e3e1-4159-977a-8dab10ff300d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.086280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0a01dc2-e3e1-4159-977a-8dab10ff300d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.086280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0a01dc2-e3e1-4159-977a-8dab10ff300d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.087043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0a01dc2-e3e1-4159-977a-8dab10ff300d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.087043] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0a01dc2-e3e1-4159-977a-8dab10ff300d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.101515] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-cef9ee3d-68cd-4411-ad09-df35823eb076 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.101515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.101515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.101515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.101515] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.101515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.101515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.102037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.102158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.102285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.102494] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-cef9ee3d-68cd-4411-ad09-df35823eb076 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.102599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.102663] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.102878] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.103368] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.103368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.103368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.103368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.103547] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.103547] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.103600] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cef9ee3d-68cd-4411-ad09-df35823eb076',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.271590] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.271590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.271590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.271590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.271590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.271590] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 already deleted. [ 950.272113] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.272180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.272339] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.272511] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.486537] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 950.486775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.486949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.487255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.487457] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.487575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.487641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.487816] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.487900] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.487995] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.590228] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0a01dc2-e3e1-4159-977a-8dab10ff300d [ 950.590228] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.590228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.590228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.590228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.590228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.590228] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0a01dc2-e3e1-4159-977a-8dab10ff300d already deleted. [ 950.590228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0a01dc2-e3e1-4159-977a-8dab10ff300d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.606953] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cef9ee3d-68cd-4411-ad09-df35823eb076: rpc.has_security_group_logging(os_id): False [ 950.634641] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.634746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.634746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.635148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.635148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.635324] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.635408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.635468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.635628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.635725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.635875] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.635986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.636052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.636197] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.636271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.636459] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.636553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.636614] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.636753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.636827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.636912] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cef9ee3d-68cd-4411-ad09-df35823eb076 is going to be created. [ 950.698566] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.698705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.698745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.699052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.699345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.711956] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cef9ee3d-68cd-4411-ad09-df35823eb076 in Status: IN_PROGRESS for 2s [ 950.744629] env[65102]: INFO networking_nsxv3.common.synchronization [req-ecb83048-6785-4606-9848-b7e79a6d43ec req-765d3006-155f-4166-b2d6-117a976f2095 tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 with Priority: HIGHEST for action security_group_members [ 950.745382] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 with Priority: HIGHEST for action security_group_members [ 950.747894] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.747894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.747894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.747894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.747894] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.747894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.747894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.747894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.747894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.747894] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('351e6bc8-ffc9-4dca-ac8a-98595980ddc4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.808157] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.808323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.808363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.810022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.810022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.810022] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 already deleted. [ 950.810022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.990728] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.062086] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 951.062328] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.251537] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.251807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.251807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.252059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.277025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.277025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.277025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.277025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.277025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.277025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.277025] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 is going to be updated. [ 951.308749] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.308908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.309000] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.309224] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.309411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.323595] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 in Status: IN_PROGRESS for 2s [ 951.493740] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.652490] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 951.652490] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f deletion is rescheduled due to dependency. [ 951.652490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.997980] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.998211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.998306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.998566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.998694] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.998810] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be updated. [ 952.035073] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.035300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.035300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.035450] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.035619] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.046266] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 952.523937] env[65102]: INFO networking_nsxv3.common.synchronization [req-33884b0f-bec1-4c06-b6b7-8723676e75dd req-318df760-217c-453e-a0da-bc5d6f1ba69e tempest-ServerRescueNegativeTestJSON-286642771 tempest-ServerRescueNegativeTestJSON-286642771-project-member] Enqueued Resource ID: 5476d54c-8894-4aeb-b26c-f1637341e27f with Priority: HIGHEST for action security_group_members [ 952.524520] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5476d54c-8894-4aeb-b26c-f1637341e27f with Priority: HIGHEST for action security_group_members [ 952.524836] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-5476d54c-8894-4aeb-b26c-f1637341e27f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.525714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.525846] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.527015] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.527015] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.527015] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.527015] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.527015] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.527015] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.527015] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5476d54c-8894-4aeb-b26c-f1637341e27f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.733270] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cef9ee3d-68cd-4411-ad09-df35823eb076 in Status: SUCCESS [ 952.733270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.030700] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.030880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.030954] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.031204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.031344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.031507] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.031645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.031690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.031824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.031899] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.031988] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5476d54c-8894-4aeb-b26c-f1637341e27f already deleted. [ 953.032084] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.037851] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-736 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.037996] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-736" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.038124] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-736" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.038430] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-736" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.038737] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.038934] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.039040] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.039819] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.039819] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.039819] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.039819] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 953.039819] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 953.040048] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 953.040048] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.040127] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 953.040264] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 953.220041] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 953.220220] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.180 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 953.220290] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 953.220427] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-736" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.220796] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-ed79bc21-5c5f-44e5-ba58-55e43c814088 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.220954] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-ed79bc21-5c5f-44e5-ba58-55e43c814088" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.221085] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-ed79bc21-5c5f-44e5-ba58-55e43c814088" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.221473] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-ed79bc21-5c5f-44e5-ba58-55e43c814088" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.221609] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed79bc21-5c5f-44e5-ba58-55e43c814088',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.333363] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 in Status: SUCCESS [ 953.333636] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 351e6bc8-ffc9-4dca-ac8a-98595980ddc4 deletion is rescheduled due to dependency. [ 953.333739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-351e6bc8-ffc9-4dca-ac8a-98595980ddc4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.724439] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.724740] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.724947] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.725491] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.725656] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.725793] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port ed79bc21-5c5f-44e5-ba58-55e43c814088 not found, creating... [ 953.726179] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.726383] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.726503] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.726824] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.726927] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.727348] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.727552] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.727673] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.727911] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.728130] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.728442] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: ed79bc21-5c5f-44e5-ba58-55e43c814088 is going to be created. [ 953.752883] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.753576] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.753864] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.754304] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.754695] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.755133] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-ed79bc21-5c5f-44e5-ba58-55e43c814088" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.059047] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 954.059477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.059648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.060288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.060288] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.060494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.060646] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.060880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.061746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.061926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.062131] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.340350] env[65102]: INFO networking_nsxv3.common.synchronization [req-33884b0f-bec1-4c06-b6b7-8723676e75dd req-21d98900-8143-4ca9-8948-20d259d18d63 service nova] Enqueued Resource ID: 5476d54c-8894-4aeb-b26c-f1637341e27f with Priority: HIGHEST for action security_group_rules [ 954.340401] env[65102]: INFO networking_nsxv3.common.synchronization [req-33884b0f-bec1-4c06-b6b7-8723676e75dd req-21d98900-8143-4ca9-8948-20d259d18d63 service nova] Enqueued Resource ID: 5476d54c-8894-4aeb-b26c-f1637341e27f with Priority: HIGHEST for action security_group_members [ 954.340539] env[65102]: INFO networking_nsxv3.common.synchronization [req-33884b0f-bec1-4c06-b6b7-8723676e75dd req-21d98900-8143-4ca9-8948-20d259d18d63 service nova] Enqueued Resource ID: ed79bc21-5c5f-44e5-ba58-55e43c814088 with Priority: HIGHEST for action port [ 954.341114] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5476d54c-8894-4aeb-b26c-f1637341e27f with Priority: HIGHEST for action security_group_rules [ 954.341321] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5476d54c-8894-4aeb-b26c-f1637341e27f with Priority: HIGHEST for action security_group_members [ 954.341376] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed79bc21-5c5f-44e5-ba58-55e43c814088 with Priority: HIGHEST for action port [ 954.341634] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5476d54c-8894-4aeb-b26c-f1637341e27f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.341715] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.341774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.342068] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.342068] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5476d54c-8894-4aeb-b26c-f1637341e27f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.342948] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-5476d54c-8894-4aeb-b26c-f1637341e27f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.343013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.343107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.343275] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.343408] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.345783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.345783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.345783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.345783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.345783] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5476d54c-8894-4aeb-b26c-f1637341e27f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.345783] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed79bc21-5c5f-44e5-ba58-55e43c814088 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.345783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed79bc21-5c5f-44e5-ba58-55e43c814088" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.345783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed79bc21-5c5f-44e5-ba58-55e43c814088" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.345783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed79bc21-5c5f-44e5-ba58-55e43c814088" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.345783] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed79bc21-5c5f-44e5-ba58-55e43c814088',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.568119] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.568307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.568398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.568709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.568895] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.569040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.569114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.569294] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.569438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.569480] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.569658] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.569764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.569829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.570019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.570170] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.570267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.570330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.570471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.570550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.570637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.570752] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.690455] env[65102]: INFO networking_nsxv3.common.synchronization [req-f3e6d79b-391e-4ea1-8446-9de45226d505 req-f767b15a-5fa6-4656-a3d5-bb4802c6b253 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGHEST for action security_group_members [ 954.690563] env[65102]: INFO networking_nsxv3.common.synchronization [req-f3e6d79b-391e-4ea1-8446-9de45226d505 req-f767b15a-5fa6-4656-a3d5-bb4802c6b253 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 954.690692] env[65102]: INFO networking_nsxv3.common.synchronization [req-f3e6d79b-391e-4ea1-8446-9de45226d505 req-f767b15a-5fa6-4656-a3d5-bb4802c6b253 tempest-SecurityGroupsTestJSON-825765339 tempest-SecurityGroupsTestJSON-825765339-project-member] Enqueued Resource ID: 082ce940-517e-4ecd-a42e-d7d185e47139 with Priority: HIGHEST for action security_group_members [ 954.692354] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGHEST for action security_group_members [ 954.692488] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daef1b5a-f25a-405c-9f5a-58444ec5510f with Priority: HIGHEST for action security_group_members [ 954.692582] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 082ce940-517e-4ecd-a42e-d7d185e47139 with Priority: HIGHEST for action security_group_members [ 954.692929] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.693038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.693098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.693406] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.693478] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.693597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.693639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.693919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.693919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.694014] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.695081] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-daef1b5a-f25a-405c-9f5a-58444ec5510f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.695081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.695270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.695270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.700093] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.700093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.700093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.700093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.700093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.700093] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daef1b5a-f25a-405c-9f5a-58444ec5510f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.700093] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-082ce940-517e-4ecd-a42e-d7d185e47139 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.700093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.700093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.700093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.700093] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.700093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.700093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.700093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.700093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.700093] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('082ce940-517e-4ecd-a42e-d7d185e47139',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.847810] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed79bc21-5c5f-44e5-ba58-55e43c814088 with status ACTIVE [ 954.847810] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.848133] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.848133] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.848245] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.848283] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.849043] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.849043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.849043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.849043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.849043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.849043] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.849753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.849753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.849753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.849753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.849753] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed79bc21-5c5f-44e5-ba58-55e43c814088 is going to be updated. [ 954.850721] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-5476d54c-8894-4aeb-b26c-f1637341e27f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.850836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.851291] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5476d54c-8894-4aeb-b26c-f1637341e27f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.919019] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.919247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.919355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.919630] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.919814] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.919978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed79bc21-5c5f-44e5-ba58-55e43c814088" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.073436] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad: rpc.has_security_group_logging(os_id): False [ 955.112833] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.113456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.113456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.113777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.160588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.160878] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.161031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.161121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.161500] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.161611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.161819] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.161922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.161983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.162182] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.162291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.162528] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.162640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.162691] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.164524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.164524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.164524] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be updated. [ 955.199638] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.199937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.200055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.200329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.200473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.200708] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.200851] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.200927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.201127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.201234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.201332] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f is going to be updated. [ 955.202761] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.203901] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.203901] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.203901] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.205877] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.205877] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.231261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.231261] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.231261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.231261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.231261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.231261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.231261] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 is going to be updated. [ 955.231261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.231261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.234828] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.235022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.252181] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.252453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.252453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.252928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.252928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.266412] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: IN_PROGRESS for 2s [ 955.269452] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.269452] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.269722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.269722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.269947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.270063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.270170] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 082ce940-517e-4ecd-a42e-d7d185e47139 is going to be updated. [ 955.272636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.272636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.272636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.295251] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 955.296317] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.298340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.298340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.298340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.298340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.318539] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 in Status: IN_PROGRESS for 2s [ 955.335783] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.335783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.335783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.335783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.335783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.353308] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 082ce940-517e-4ecd-a42e-d7d185e47139 in Status: IN_PROGRESS for 2s [ 955.355526] env[65102]: INFO networking_nsxv3.common.synchronization [None req-d5cba982-176f-4720-8f05-df32fd1da77d None None] Enqueued Resource ID: af569401-06c1-4ad7-8138-7a2917a0f936 with Priority: HIGHEST for action port [ 955.356208] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af569401-06c1-4ad7-8138-7a2917a0f936 with Priority: HIGHEST for action port [ 955.356527] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5476d54c-8894-4aeb-b26c-f1637341e27f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.357483] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-af569401-06c1-4ad7-8138-7a2917a0f936 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.357580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af569401-06c1-4ad7-8138-7a2917a0f936" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.357625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af569401-06c1-4ad7-8138-7a2917a0f936" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.357987] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af569401-06c1-4ad7-8138-7a2917a0f936" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.357987] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af569401-06c1-4ad7-8138-7a2917a0f936',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.860414] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.860730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.860730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.861433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.862423] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.862623] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5476d54c-8894-4aeb-b26c-f1637341e27f is going to be created. [ 955.868228] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af569401-06c1-4ad7-8138-7a2917a0f936 [ 955.868465] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.868601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.868708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.868928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.869086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.869122] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af569401-06c1-4ad7-8138-7a2917a0f936 already deleted. [ 955.869208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af569401-06c1-4ad7-8138-7a2917a0f936" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.892578] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.892728] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.892803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.893117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.893291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.905273] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5476d54c-8894-4aeb-b26c-f1637341e27f in Status: UNINITIALIZED for 2s [ 957.280765] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daef1b5a-f25a-405c-9f5a-58444ec5510f in Status: SUCCESS [ 957.281204] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daef1b5a-f25a-405c-9f5a-58444ec5510f deletion is rescheduled due to dependency. [ 957.281204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daef1b5a-f25a-405c-9f5a-58444ec5510f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.330498] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 957.330754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.333171] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 in Status: SUCCESS [ 957.333430] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 deletion is rescheduled due to dependency. [ 957.333556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.364090] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 082ce940-517e-4ecd-a42e-d7d185e47139 in Status: SUCCESS [ 957.364218] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 082ce940-517e-4ecd-a42e-d7d185e47139 deletion is rescheduled due to dependency. [ 957.364352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-082ce940-517e-4ecd-a42e-d7d185e47139" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.905975] env[65102]: INFO networking_nsxv3.common.synchronization [None req-0af8c4e5-47bf-4954-b284-a4e3bd65c441 None None] Enqueued Resource ID: cfdb7fd8-86b3-4611-8db8-125fcac53273 with Priority: HIGHEST for action port [ 957.908705] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfdb7fd8-86b3-4611-8db8-125fcac53273 with Priority: HIGHEST for action port [ 957.908705] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfdb7fd8-86b3-4611-8db8-125fcac53273 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.908705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfdb7fd8-86b3-4611-8db8-125fcac53273" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.909114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfdb7fd8-86b3-4611-8db8-125fcac53273" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.909114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfdb7fd8-86b3-4611-8db8-125fcac53273" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.909214] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfdb7fd8-86b3-4611-8db8-125fcac53273',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.921651] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5476d54c-8894-4aeb-b26c-f1637341e27f in Status: SUCCESS [ 957.921651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.921791] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.921922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.922180] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.922320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.922414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.922805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.922805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.922958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.923016] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5476d54c-8894-4aeb-b26c-f1637341e27f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.411765] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfdb7fd8-86b3-4611-8db8-125fcac53273 [ 958.412037] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.412037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.412037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.412267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.412402] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.412520] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfdb7fd8-86b3-4611-8db8-125fcac53273 already deleted. [ 958.412640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfdb7fd8-86b3-4611-8db8-125fcac53273" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.425290] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5476d54c-8894-4aeb-b26c-f1637341e27f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.931310] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5476d54c-8894-4aeb-b26c-f1637341e27f: rpc.has_security_group_logging(os_id): False [ 958.953895] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.953895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.953895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.953895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.953895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.953895] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.953895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.953895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.953895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.953895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.953895] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5476d54c-8894-4aeb-b26c-f1637341e27f is going to be created. [ 959.020822] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.020822] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.020822] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.020822] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.021231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.031249] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5476d54c-8894-4aeb-b26c-f1637341e27f in Status: IN_PROGRESS for 2s [ 959.272032] env[65102]: INFO networking_nsxv3.common.synchronization [req-fc21f708-b4ce-49ef-ad38-f2c025f59679 req-f85ca17e-fca0-4885-8d3e-808aa97dfa60 tempest-DeleteServersTestJSON-1773899535 tempest-DeleteServersTestJSON-1773899535-project-member] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 959.272032] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 959.272032] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.272265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.272265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.272949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.272949] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.272949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.272949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.272949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.273403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.273403] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.592401] env[65102]: INFO networking_nsxv3.common.synchronization [req-0559a8d6-435e-4af3-969e-947f3f8180cd req-4a2da144-2608-41f4-a050-69f58a6c721d tempest-InstanceActionsNegativeTestJSON-930462260 tempest-InstanceActionsNegativeTestJSON-930462260-project-member] Enqueued Resource ID: cef9ee3d-68cd-4411-ad09-df35823eb076 with Priority: HIGHEST for action security_group_members [ 959.592966] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cef9ee3d-68cd-4411-ad09-df35823eb076 with Priority: HIGHEST for action security_group_members [ 959.593344] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-cef9ee3d-68cd-4411-ad09-df35823eb076 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.593516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.593615] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.593868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.595035] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.595207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.595318] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.595563] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.595725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.595870] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cef9ee3d-68cd-4411-ad09-df35823eb076',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.776589] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.776805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.776914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.778023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.778023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.778023] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.778023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.778023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.778023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.778023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.778023] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 959.807022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.807022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.807022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.807022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.807022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.816653] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 960.098457] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.098671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.098722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.098958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.099113] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.099292] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.099441] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.099509] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.099714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.099782] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.099922] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cef9ee3d-68cd-4411-ad09-df35823eb076 is going to be updated. [ 960.130229] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.130555] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.130555] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.130662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.130788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.140767] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cef9ee3d-68cd-4411-ad09-df35823eb076 in Status: IN_PROGRESS for 2s [ 961.045341] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5476d54c-8894-4aeb-b26c-f1637341e27f in Status: SUCCESS [ 961.045341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.830344] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 961.830972] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f deletion is rescheduled due to dependency. [ 961.831205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.152043] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cef9ee3d-68cd-4411-ad09-df35823eb076 in Status: SUCCESS [ 962.152043] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cef9ee3d-68cd-4411-ad09-df35823eb076 deletion is rescheduled due to dependency. [ 962.152043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cef9ee3d-68cd-4411-ad09-df35823eb076" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.594814] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 964.594814] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 965.523702] env[65102]: INFO networking_nsxv3.common.synchronization [req-5ebf757e-aef6-49b3-b03a-3937d99e8344 req-f453a83f-1eb2-47ab-bf27-fc2ed6c5c8c5 tempest-ServerPasswordTestJSON-1404653062 tempest-ServerPasswordTestJSON-1404653062-project-member] Enqueued Resource ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda with Priority: HIGHEST for action security_group_members [ 965.524329] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda with Priority: HIGHEST for action security_group_members [ 965.524656] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6cdc2b-9511-477a-8ea2-7f547770beda taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.524783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.524838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.526311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.526311] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.526311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.526311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.526311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.526311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.526311] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6cdc2b-9511-477a-8ea2-7f547770beda',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.904738] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-437 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.904738] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-437" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.904738] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-437" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.904738] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-437" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.904738] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.904738] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.904738] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.905440] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.906159] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.906384] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 965.906503] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 965.906673] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 965.906717] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 965.906818] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 965.906924] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 965.907073] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 965.938355] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 965.938539] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 965.938753] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 965.938869] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-437" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.939200] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-69598f61-761f-4866-8b1d-561df2ebbe70 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.939372] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-69598f61-761f-4866-8b1d-561df2ebbe70" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.939491] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-69598f61-761f-4866-8b1d-561df2ebbe70" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.939833] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-69598f61-761f-4866-8b1d-561df2ebbe70" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.940028] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69598f61-761f-4866-8b1d-561df2ebbe70',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.029060] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.029329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.029329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.029482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.029571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.029789] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.029893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.029946] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.030155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.030333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.030333] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda already deleted. [ 966.030333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.444202] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.444202] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.444202] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.444202] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.444202] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.444536] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 69598f61-761f-4866-8b1d-561df2ebbe70 not found, creating... [ 966.444908] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.445071] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.445250] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.445514] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.445764] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.446124] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.446341] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.446492] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.446731] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.446901] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.447083] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 69598f61-761f-4866-8b1d-561df2ebbe70 is going to be created. [ 966.469237] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.469487] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.469658] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.469974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.470324] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.471429] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-69598f61-761f-4866-8b1d-561df2ebbe70" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.264563] env[65102]: INFO networking_nsxv3.common.synchronization [req-5ebf757e-aef6-49b3-b03a-3937d99e8344 req-e3a6dcee-708f-4970-a4f7-a147b2561685 service nova] Enqueued Resource ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda with Priority: HIGHEST for action security_group_rules [ 967.265260] env[65102]: INFO networking_nsxv3.common.synchronization [req-5ebf757e-aef6-49b3-b03a-3937d99e8344 req-e3a6dcee-708f-4970-a4f7-a147b2561685 service nova] Enqueued Resource ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda with Priority: HIGHEST for action security_group_members [ 967.265508] env[65102]: INFO networking_nsxv3.common.synchronization [req-5ebf757e-aef6-49b3-b03a-3937d99e8344 req-e3a6dcee-708f-4970-a4f7-a147b2561685 service nova] Enqueued Resource ID: 69598f61-761f-4866-8b1d-561df2ebbe70 with Priority: HIGHEST for action port [ 967.266583] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda with Priority: HIGHEST for action security_group_rules [ 967.266814] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda with Priority: HIGHEST for action security_group_members [ 967.267591] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69598f61-761f-4866-8b1d-561df2ebbe70 with Priority: HIGHEST for action port [ 967.267591] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c6cdc2b-9511-477a-8ea2-7f547770beda taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.267591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.267591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.267879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.267879] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c6cdc2b-9511-477a-8ea2-7f547770beda',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.270071] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6cdc2b-9511-477a-8ea2-7f547770beda taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.270071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.270071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.270071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.270071] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.270071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.270071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.270071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.270347] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.270347] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6cdc2b-9511-477a-8ea2-7f547770beda',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.272418] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-69598f61-761f-4866-8b1d-561df2ebbe70 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.273561] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69598f61-761f-4866-8b1d-561df2ebbe70" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.274297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69598f61-761f-4866-8b1d-561df2ebbe70" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.274488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69598f61-761f-4866-8b1d-561df2ebbe70" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.274574] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69598f61-761f-4866-8b1d-561df2ebbe70',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.780022] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c6cdc2b-9511-477a-8ea2-7f547770beda',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.780022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6cdc2b-9511-477a-8ea2-7f547770beda taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.780022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.780022] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69598f61-761f-4866-8b1d-561df2ebbe70 with status ACTIVE [ 967.780022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.780022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.780022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.780976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.781197] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.781538] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.781790] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.781936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.782207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.782373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.782714] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.783132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.783422] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.783700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.783869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.784048] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69598f61-761f-4866-8b1d-561df2ebbe70 is going to be updated. [ 967.815502] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.815502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.815502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.815502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.815502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.815502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69598f61-761f-4866-8b1d-561df2ebbe70" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.280775] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c6cdc2b-9511-477a-8ea2-7f547770beda',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.784492] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.784742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.784846] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.785192] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.785320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.785458] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda is going to be created. [ 968.814558] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.814558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.814558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.814708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.814783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.826357] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda in Status: UNINITIALIZED for 2s [ 970.024539] env[65102]: INFO networking_nsxv3.common.synchronization [req-be381737-99f2-458d-be3a-6a73ab8ff473 req-90624cae-cdba-43cf-afda-af674ceb6ce6 tempest-ImagesTestJSON-2026451637 tempest-ImagesTestJSON-2026451637-project-member] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 970.025340] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 970.025960] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.026222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.026342] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.026702] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.027612] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.027612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.027612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.027796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.027909] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.028132] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.532699] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.836994] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda in Status: SUCCESS [ 970.837738] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.837738] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.837738] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.837905] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.838031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.838154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.838376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.838443] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.839451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.839451] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c6cdc2b-9511-477a-8ea2-7f547770beda',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.034981] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.341908] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6cdc2b-9511-477a-8ea2-7f547770beda taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.341908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.341908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.341908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.341908] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.341908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.341908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.341908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.341908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.342428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.342428] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6cdc2b-9511-477a-8ea2-7f547770beda taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.342428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.342428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.342428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.342663] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.342730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.342769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.342963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.344089] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.344089] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.344089] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c6cdc2b-9511-477a-8ea2-7f547770beda',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.537588] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.537753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.537857] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.538170] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.538271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.538379] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be updated. [ 971.580822] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.581028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.581158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.581467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.581791] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.593650] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 971.846424] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c6cdc2b-9511-477a-8ea2-7f547770beda: rpc.has_security_group_logging(os_id): False [ 971.873515] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.873838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.873838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.873942] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.874120] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.874385] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.874500] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.874564] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.874738] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.874819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.874998] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.875171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.875231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.875372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.875444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.875629] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.875718] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.875777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.876026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.876026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.876158] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda is going to be created. [ 971.939957] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.940155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.941036] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.941036] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.941036] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.955071] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda in Status: IN_PROGRESS for 2s [ 973.605884] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 973.606252] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.707532] env[65102]: INFO networking_nsxv3.common.synchronization [req-477d86d2-bc2b-4d05-b776-5b285f1df8f6 req-3511b2b2-c286-4854-a47d-b283da2cc4de tempest-ServerDiskConfigTestJSON-1771527805 tempest-ServerDiskConfigTestJSON-1771527805-project-member] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 973.708077] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 973.708404] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.708533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.708600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.708807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.708965] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.709095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.709263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.709368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.709413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.709512] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.967910] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda in Status: SUCCESS [ 973.968176] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.086720] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-312 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.086987] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.087217] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.087617] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.087939] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.088136] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.088262] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.088516] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.088685] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.088964] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.089104] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.089227] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.089359] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.089482] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.089600] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.089745] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.120103] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.120326] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 974.120456] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.120639] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.121029] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-a34ba705-83e3-4da1-ad09-b23e6fc8d54e taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.121172] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-a34ba705-83e3-4da1-ad09-b23e6fc8d54e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.121418] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-a34ba705-83e3-4da1-ad09-b23e6fc8d54e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.121689] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-a34ba705-83e3-4da1-ad09-b23e6fc8d54e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.121831] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a34ba705-83e3-4da1-ad09-b23e6fc8d54e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.212139] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.212319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.212319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.212495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.212600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.212809] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.212948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.212948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.213130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.213184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.213274] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 974.241109] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.241265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.241335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.241538] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.241686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.250991] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 974.624576] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.624947] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.624947] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.625249] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.625466] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.625697] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port a34ba705-83e3-4da1-ad09-b23e6fc8d54e not found, creating... [ 974.626056] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.626283] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.626429] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.626683] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.626832] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.627149] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.627343] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.627471] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.627691] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.627823] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.628015] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: a34ba705-83e3-4da1-ad09-b23e6fc8d54e is going to be created. [ 974.652063] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.652063] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.652063] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.652377] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.652589] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.652847] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-a34ba705-83e3-4da1-ad09-b23e6fc8d54e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.411286] env[65102]: INFO networking_nsxv3.common.synchronization [req-477d86d2-bc2b-4d05-b776-5b285f1df8f6 req-91ce0607-7c13-4ed4-a9e6-24b538a65e07 service nova] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_rules [ 975.411286] env[65102]: INFO networking_nsxv3.common.synchronization [req-477d86d2-bc2b-4d05-b776-5b285f1df8f6 req-91ce0607-7c13-4ed4-a9e6-24b538a65e07 service nova] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 975.411286] env[65102]: INFO networking_nsxv3.common.synchronization [req-477d86d2-bc2b-4d05-b776-5b285f1df8f6 req-91ce0607-7c13-4ed4-a9e6-24b538a65e07 service nova] Enqueued Resource ID: a34ba705-83e3-4da1-ad09-b23e6fc8d54e with Priority: HIGHEST for action port [ 975.412136] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_rules [ 975.412136] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 975.412136] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34ba705-83e3-4da1-ad09-b23e6fc8d54e with Priority: HIGHEST for action port [ 975.412716] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.412716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.412716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.412716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.412716] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.414038] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.414038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.414624] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-a34ba705-83e3-4da1-ad09-b23e6fc8d54e taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.414624] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a34ba705-83e3-4da1-ad09-b23e6fc8d54e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.414624] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a34ba705-83e3-4da1-ad09-b23e6fc8d54e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.414624] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a34ba705-83e3-4da1-ad09-b23e6fc8d54e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.414624] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a34ba705-83e3-4da1-ad09-b23e6fc8d54e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.916745] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.917107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.917107] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a34ba705-83e3-4da1-ad09-b23e6fc8d54e with status ACTIVE [ 975.918739] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.918739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.918739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.918739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.918739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.918739] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.918739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.918739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.918739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.918739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.918739] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.918739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.918739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.918739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.918739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.919482] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a34ba705-83e3-4da1-ad09-b23e6fc8d54e is going to be updated. [ 975.946794] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.946978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.947037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.947368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.947667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.947852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a34ba705-83e3-4da1-ad09-b23e6fc8d54e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.262064] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 4s [ 978.274373] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 978.274373] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f deletion is rescheduled due to dependency. [ 978.274830] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.274830] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.274952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.275199] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.275324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.275382] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.275550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.275633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.275730] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.778938] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.268925] env[65102]: INFO networking_nsxv3.common.synchronization [req-a78a2af5-c1e3-4eed-9c62-3af1e38e751f req-294744c4-90a8-4b59-b3bf-f83170feff10 tempest-ServerPasswordTestJSON-1404653062 tempest-ServerPasswordTestJSON-1404653062-project-member] Enqueued Resource ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda with Priority: HIGHEST for action security_group_members [ 979.268925] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda with Priority: HIGHEST for action security_group_members [ 979.268925] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6cdc2b-9511-477a-8ea2-7f547770beda taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.268925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.268925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.268925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.268925] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.268925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.268925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.268925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.268925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.268925] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6cdc2b-9511-477a-8ea2-7f547770beda',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.281512] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.772483] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.772876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.773040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.773386] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.773541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.773865] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.774012] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.774088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.774264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.774379] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.774477] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda is going to be updated. [ 979.786783] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.786971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.786971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.787192] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.787281] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.787377] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 979.805756] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.805892] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.805963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.806193] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.806326] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.815174] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda in Status: IN_PROGRESS for 2s [ 979.818085] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.818226] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.818316] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.818474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.818618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.826310] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 981.830156] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda in Status: SUCCESS [ 981.830537] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6cdc2b-9511-477a-8ea2-7f547770beda deletion is rescheduled due to dependency. [ 981.830537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6cdc2b-9511-477a-8ea2-7f547770beda" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.843717] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 981.843939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.844129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.844358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.844578] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.844716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.844796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.844972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.845065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.845155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.845250] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.349172] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.349172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.349172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.349172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.349172] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.349172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.349172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.349172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.349172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.349172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.349172] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.349172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.349172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.349172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.349172] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.349172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.349772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.349772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.349772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.349772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.349772] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.852815] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a0c01bc-dc67-4824-bf8b-60c7f41f292f: rpc.has_security_group_logging(os_id): False [ 982.876483] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.876730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.876783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.876995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.877164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.877373] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.877476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.877587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.877756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.877831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.878049] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.878144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.878204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.878342] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.878414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.878595] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.878675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.878735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.878865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.878938] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.879030] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 982.962294] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.962537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.962537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.962729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.962883] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.986744] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 983.426836] env[65102]: INFO networking_nsxv3.common.synchronization [req-7b0b011b-4373-4c16-b605-2bcd3180bcd3 req-2760bc3a-6b0f-4b92-9c66-187e74b4655d tempest-ServersAdminNegativeTestJSON-1381091624 tempest-ServersAdminNegativeTestJSON-1381091624-project-member] Enqueued Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_members [ 983.427538] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_members [ 983.427852] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.428092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.430694] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.430983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.431064] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.431169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.431230] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.431396] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.431482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.431587] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.735250] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.735490] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.735620] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.735895] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.736234] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.736395] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.736511] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.736807] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.736966] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.737217] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 983.738206] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 983.738347] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 983.738464] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 983.738584] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 983.738695] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 983.738831] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 983.760951] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 983.761142] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 983.761285] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 983.761461] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-438" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.761810] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-51b0e4fe-384d-4ad6-8341-4525d8b55ffa taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.762009] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-51b0e4fe-384d-4ad6-8341-4525d8b55ffa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.762210] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-51b0e4fe-384d-4ad6-8341-4525d8b55ffa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.762543] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-51b0e4fe-384d-4ad6-8341-4525d8b55ffa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.762685] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51b0e4fe-384d-4ad6-8341-4525d8b55ffa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.937337] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.265781] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.266049] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.266269] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.266518] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.266711] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.266905] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 51b0e4fe-384d-4ad6-8341-4525d8b55ffa not found, creating... [ 984.267411] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.267570] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.267701] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.268039] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.268435] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.268927] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.269239] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.269469] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.269867] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.270104] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.270403] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 51b0e4fe-384d-4ad6-8341-4525d8b55ffa is going to be created. [ 984.293112] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.293361] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.293488] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.293784] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.294040] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.294292] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-51b0e4fe-384d-4ad6-8341-4525d8b55ffa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.440048] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.943378] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.943378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.943813] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.943813] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.943813] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.943958] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd79c243-92bc-47a2-80ad-114091c4bab9 is going to be updated. [ 984.975494] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.975937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.975937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.976070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.976304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.988459] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: IN_PROGRESS for 2s [ 984.996228] env[65102]: INFO networking_nsxv3.common.synchronization [req-7b0b011b-4373-4c16-b605-2bcd3180bcd3 req-a80ff371-630f-4fa9-9502-df45f91abed2 service nova] Enqueued Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_rules [ 984.996228] env[65102]: INFO networking_nsxv3.common.synchronization [req-7b0b011b-4373-4c16-b605-2bcd3180bcd3 req-a80ff371-630f-4fa9-9502-df45f91abed2 service nova] Enqueued Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_members [ 984.996228] env[65102]: INFO networking_nsxv3.common.synchronization [req-7b0b011b-4373-4c16-b605-2bcd3180bcd3 req-a80ff371-630f-4fa9-9502-df45f91abed2 service nova] Enqueued Resource ID: 51b0e4fe-384d-4ad6-8341-4525d8b55ffa with Priority: HIGHEST for action port [ 984.997057] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_rules [ 984.997057] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_members [ 984.997057] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51b0e4fe-384d-4ad6-8341-4525d8b55ffa with Priority: HIGHEST for action port [ 984.997237] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.997383] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.997482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.997646] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.997777] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.998935] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.999654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.999654] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-51b0e4fe-384d-4ad6-8341-4525d8b55ffa taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.999654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51b0e4fe-384d-4ad6-8341-4525d8b55ffa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.999654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51b0e4fe-384d-4ad6-8341-4525d8b55ffa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.999654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51b0e4fe-384d-4ad6-8341-4525d8b55ffa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.999978] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51b0e4fe-384d-4ad6-8341-4525d8b55ffa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.001552] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 985.001881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.501578] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.501836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.503081] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51b0e4fe-384d-4ad6-8341-4525d8b55ffa with status ACTIVE [ 985.503316] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.503394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.503447] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.503665] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.503825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.504063] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.504279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.504279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.504409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.504466] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.504649] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.504745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.504798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.504935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.505021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.505107] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51b0e4fe-384d-4ad6-8341-4525d8b55ffa is going to be updated. [ 985.533191] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.533191] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.533191] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.533191] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.533191] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.533191] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51b0e4fe-384d-4ad6-8341-4525d8b55ffa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.701219] env[65102]: INFO networking_nsxv3.common.synchronization [req-4c10ccb4-b1a0-4089-9410-4b1f8e894789 req-53c0f885-3806-4e12-b85f-3fadb5a4322f tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 with Priority: HIGHEST for action security_group_members [ 985.701826] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 with Priority: HIGHEST for action security_group_members [ 985.702187] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce19aa8e-b26d-4484-8765-4894bdbb95a0 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.702335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.702413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.702638] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.702804] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.703048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.703048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.703172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.703263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.703405] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce19aa8e-b26d-4484-8765-4894bdbb95a0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.075206] env[65102]: INFO networking_nsxv3.common.synchronization [req-89ca3178-9275-4636-a4a2-6eb861311296 req-4bc8441b-ffc1-4d9b-ad37-8813cc91d51e tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_members [ 986.076040] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_members [ 986.077077] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.077077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.077077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.077301] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.077342] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.077424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.077510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.077633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.077753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.077971] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.205556] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.205750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.205800] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.205992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.228683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.228879] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.229305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.229417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.229665] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.229765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.229866] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 is going to be updated. [ 986.264528] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.264838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.264956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.265356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.265606] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.277260] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 in Status: IN_PROGRESS for 2s [ 986.525282] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.525541] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.525696] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.526285] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.526590] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.526742] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.526905] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.527165] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.527314] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.527528] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.527635] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.527749] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.527857] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.528081] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.528081] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.528231] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.549779] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.550045] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 986.550204] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.550361] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.550955] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.550955] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.551297] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.551413] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.551484] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.580829] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.581030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.581082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.581312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.581422] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.584021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.584021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.584021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.584021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.584021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.584021] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 already deleted. [ 986.584021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.999968] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: SUCCESS [ 987.003636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.003636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.003636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.003636] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.003636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.003636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.003636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.003636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.003636] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.054613] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.056974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.056974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.056974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.056974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.056974] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d not found, creating... [ 987.056974] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.056974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.056974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.056974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.056974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.058263] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.058900] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.061174] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.061174] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.061174] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.061174] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d is going to be created. [ 987.087894] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.088674] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.088674] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.088674] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.089078] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.089078] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.505312] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.794036] env[65102]: INFO networking_nsxv3.common.synchronization [req-89ca3178-9275-4636-a4a2-6eb861311296 req-88e1df0e-b19a-492c-8a0d-645f5bd2c901 service nova] Enqueued Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_rules [ 987.794257] env[65102]: INFO networking_nsxv3.common.synchronization [req-89ca3178-9275-4636-a4a2-6eb861311296 req-88e1df0e-b19a-492c-8a0d-645f5bd2c901 service nova] Enqueued Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_members [ 987.794413] env[65102]: INFO networking_nsxv3.common.synchronization [req-89ca3178-9275-4636-a4a2-6eb861311296 req-88e1df0e-b19a-492c-8a0d-645f5bd2c901 service nova] Enqueued Resource ID: 75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d with Priority: HIGHEST for action port [ 987.795446] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_rules [ 987.795640] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_members [ 987.795808] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d with Priority: HIGHEST for action port [ 987.796052] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.796191] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.796242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.796474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.796549] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.799998] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.799998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.799998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.799998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.799998] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.799998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.799998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.799998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.799998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.799998] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.803718] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.803881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.803999] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.804097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.804170] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.009084] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.289246] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 in Status: SUCCESS [ 988.289599] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 deletion is rescheduled due to dependency. [ 988.289599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.306171] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.307303] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.307460] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.307587] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d with status ACTIVE [ 988.307741] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.307841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.307911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.308166] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.308267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.308425] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.308523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.308585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.308724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.308801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.308993] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.310394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.310897] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.310897] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.310897] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.310897] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d is going to be updated. [ 988.337839] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.338095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.338095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.338372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.338542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.338731] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75cfc6b6-0af5-41f1-9ccf-8f5a86fdfd1d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.512700] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.512700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.512700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.512700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.512700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.512700] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd79c243-92bc-47a2-80ad-114091c4bab9 is going to be updated. [ 988.543575] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.543739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.543808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.544028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.544179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.554421] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: IN_PROGRESS for 2s [ 988.812603] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.316148] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.316431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.316431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.316621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.316712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.316815] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 is going to be created. [ 989.344851] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.344851] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.344851] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.344851] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.345248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.354805] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: UNINITIALIZED for 2s [ 990.564964] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: SUCCESS [ 990.565291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.565291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.565533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.565758] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.565879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.565945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.566153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.566283] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.566374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.566465] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.655320] env[65102]: INFO networking_nsxv3.common.synchronization [req-33d53a18-645a-4378-a7e3-502beb38acbd req-beed8279-709a-49b7-b33e-b4469510d110 tempest-ServerAddressesNegativeTestJSON-1826277776 tempest-ServerAddressesNegativeTestJSON-1826277776-project-member] Enqueued Resource ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 with Priority: HIGHEST for action security_group_members [ 990.655994] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 with Priority: HIGHEST for action security_group_members [ 990.656429] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.656429] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.656429] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.659460] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.659460] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.659460] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.659460] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.659460] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.659460] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.659460] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.068531] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.068775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.068852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.069093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.069359] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.069485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.069485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.069645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.069733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.069822] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.070017] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.070184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.070292] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.070390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.070576] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.070655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.070693] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.070844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.070884] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.070964] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.071175] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.084828] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-848 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.084828] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-848" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.088293] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-848" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.088293] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-848" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.088293] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.088293] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.088293] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.088293] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.088293] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.088293] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.088293] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.088293] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.088293] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.088293] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.088293] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.088293] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.114423] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.114665] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 991.114795] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.115149] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-848" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.115373] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-8f09ac6e-ef41-4d62-b1fd-acf86cfbed59 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.115594] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-8f09ac6e-ef41-4d62-b1fd-acf86cfbed59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.115725] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-8f09ac6e-ef41-4d62-b1fd-acf86cfbed59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.116380] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-8f09ac6e-ef41-4d62-b1fd-acf86cfbed59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.116576] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f09ac6e-ef41-4d62-b1fd-acf86cfbed59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.159885] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.160211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.160211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.160519] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.160618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.160861] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.161033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.161151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.162260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.162260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.162260] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 already deleted. [ 991.162260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.365192] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: SUCCESS [ 991.365506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.365891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.366239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.366530] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.366714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.366831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.367094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.367234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.367384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.367593] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.575904] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd79c243-92bc-47a2-80ad-114091c4bab9: rpc.has_security_group_logging(os_id): False [ 991.596811] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.596811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.596811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.596811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.596811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.597490] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.597490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.597490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.597490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.597762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.597825] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.597933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.598043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.598315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.598401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.598743] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.598912] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.599119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.599282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.599378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.599482] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd79c243-92bc-47a2-80ad-114091c4bab9 is going to be updated. [ 991.621235] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.621428] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.621428] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.621767] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.622095] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.622198] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 8f09ac6e-ef41-4d62-b1fd-acf86cfbed59 not found, creating... [ 991.622510] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.623042] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.623042] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.623176] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.623251] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.623593] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.623779] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.623879] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.624136] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.624302] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.624465] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 8f09ac6e-ef41-4d62-b1fd-acf86cfbed59 is going to be created. [ 991.648718] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.649099] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.649099] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.649427] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.649698] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.649942] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-8f09ac6e-ef41-4d62-b1fd-acf86cfbed59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.668281] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.668471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.668518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.668708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.668878] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.689054] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: IN_PROGRESS for 2s [ 991.871839] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.374919] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9b36c7e-229d-48ea-b61f-94b35a51b7f4: rpc.has_security_group_logging(os_id): False [ 992.394796] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.395795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.395888] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.396113] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.396224] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.396486] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.396598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.396660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.397252] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.397252] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.397252] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 is going to be created. [ 992.444420] env[65102]: INFO networking_nsxv3.common.synchronization [req-33d53a18-645a-4378-a7e3-502beb38acbd req-3c9cd862-6970-48b8-8237-504d45bba873 service nova] Enqueued Resource ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 with Priority: HIGHEST for action security_group_rules [ 992.445046] env[65102]: INFO networking_nsxv3.common.synchronization [req-33d53a18-645a-4378-a7e3-502beb38acbd req-3c9cd862-6970-48b8-8237-504d45bba873 service nova] Enqueued Resource ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 with Priority: HIGHEST for action security_group_members [ 992.445046] env[65102]: INFO networking_nsxv3.common.synchronization [req-33d53a18-645a-4378-a7e3-502beb38acbd req-3c9cd862-6970-48b8-8237-504d45bba873 service nova] Enqueued Resource ID: 8f09ac6e-ef41-4d62-b1fd-acf86cfbed59 with Priority: HIGHEST for action port [ 992.445279] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 with Priority: HIGHEST for action security_group_rules [ 992.445439] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 with Priority: HIGHEST for action security_group_members [ 992.445725] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f09ac6e-ef41-4d62-b1fd-acf86cfbed59 with Priority: HIGHEST for action port [ 992.445863] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.445983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.446705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.446705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.446705] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.447699] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.447864] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.447989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.448279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.448464] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.448562] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.448636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.448845] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.448882] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.448985] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.450430] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f09ac6e-ef41-4d62-b1fd-acf86cfbed59 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.450577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f09ac6e-ef41-4d62-b1fd-acf86cfbed59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.450625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f09ac6e-ef41-4d62-b1fd-acf86cfbed59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.450789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f09ac6e-ef41-4d62-b1fd-acf86cfbed59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.450864] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f09ac6e-ef41-4d62-b1fd-acf86cfbed59',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.456309] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.456461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.456512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.457085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.457085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.469136] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: IN_PROGRESS for 2s [ 992.953020] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.954314] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.954471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.954596] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f09ac6e-ef41-4d62-b1fd-acf86cfbed59 with status ACTIVE [ 992.954760] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.954864] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.954928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.955355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.955355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.955570] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.955687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.955761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.956026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.956108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.956348] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.956444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.956519] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.956659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.956734] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.956823] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f09ac6e-ef41-4d62-b1fd-acf86cfbed59 is going to be updated. [ 992.990312] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.990312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.990312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.990515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.990653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.990815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f09ac6e-ef41-4d62-b1fd-acf86cfbed59" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.459010] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.708356] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: SUCCESS [ 993.708356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.962121] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.962598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.962598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.962700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.962831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.962955] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 is going to be created. [ 994.003384] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.003540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.003588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.003786] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.003951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.023565] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 in Status: UNINITIALIZED for 2s [ 994.486784] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: SUCCESS [ 994.486989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.035356] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 in Status: SUCCESS [ 996.035698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.035698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.035830] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.037027] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.037027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.037027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.037027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.037027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.037027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.037027] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.539544] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.539858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.539910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.540163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.540368] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.541011] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.541115] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.541307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.541401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.541527] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.541701] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.541818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.541879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.542058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.542212] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.542324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.542384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.542672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.542754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.542841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.542964] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.045707] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7: rpc.has_security_group_logging(os_id): False [ 997.070479] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.070671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.070755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.070963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.071071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.071979] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.071979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.071979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.071979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.071979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.071979] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.071979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.072541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.072541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.072541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.072541] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.072710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.072710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.072815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.073805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.073805] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 is going to be created. [ 997.088053] env[65102]: INFO networking_nsxv3.common.synchronization [req-e6da290d-bcc8-48ec-9e13-820af5778d46 req-f9c428d8-0ff6-4fa3-b531-ec9f27f18076 tempest-ServerActionsTestOtherB-1046242315 tempest-ServerActionsTestOtherB-1046242315-project-member] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 997.089282] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 997.089661] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.089824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.089940] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.090247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.090470] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.090633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.090799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.090948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.091116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.091265] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.150073] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.150612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.150612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.150612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.150736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.168336] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 in Status: IN_PROGRESS for 2s [ 997.545988] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.545988] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.546211] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.546370] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.546802] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.546802] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.547143] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.547143] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.547263] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.547514] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.547648] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.547735] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.547843] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.547973] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.548099] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.548306] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.570302] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.570478] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 997.570643] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.570890] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.571309] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-416a2590-6a42-4a32-a922-a9d5f95786d6 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.571531] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-416a2590-6a42-4a32-a922-a9d5f95786d6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.571698] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-416a2590-6a42-4a32-a922-a9d5f95786d6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.572041] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-416a2590-6a42-4a32-a922-a9d5f95786d6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.572191] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('416a2590-6a42-4a32-a922-a9d5f95786d6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.593717] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.593922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.594051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.594359] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.594503] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.594750] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.594859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.594923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.595103] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.595184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.595560] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be updated. [ 997.621945] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.622259] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.622462] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.622582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.622733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.633637] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: IN_PROGRESS for 2s [ 998.075289] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.075769] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.075769] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.076193] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.076532] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.076807] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 416a2590-6a42-4a32-a922-a9d5f95786d6 not found, creating... [ 998.077270] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.077495] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.077713] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.078784] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.078784] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.078784] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.079057] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.079240] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.079593] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.079762] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.080583] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 416a2590-6a42-4a32-a922-a9d5f95786d6 is going to be created. [ 998.101604] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.101864] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.101987] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.102548] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.102820] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.103100] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-416a2590-6a42-4a32-a922-a9d5f95786d6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.808074] env[65102]: INFO networking_nsxv3.common.synchronization [req-e6da290d-bcc8-48ec-9e13-820af5778d46 req-47cd3864-5ece-4803-94dd-670a7a158cd7 service nova] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_rules [ 998.808244] env[65102]: INFO networking_nsxv3.common.synchronization [req-e6da290d-bcc8-48ec-9e13-820af5778d46 req-47cd3864-5ece-4803-94dd-670a7a158cd7 service nova] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 998.808381] env[65102]: INFO networking_nsxv3.common.synchronization [req-e6da290d-bcc8-48ec-9e13-820af5778d46 req-47cd3864-5ece-4803-94dd-670a7a158cd7 service nova] Enqueued Resource ID: 416a2590-6a42-4a32-a922-a9d5f95786d6 with Priority: HIGHEST for action port [ 998.808961] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_rules [ 998.809275] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 998.809398] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 416a2590-6a42-4a32-a922-a9d5f95786d6 with Priority: HIGHEST for action port [ 998.809684] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.809805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.809873] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.810090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.810161] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.811791] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.812067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.812146] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-416a2590-6a42-4a32-a922-a9d5f95786d6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.812337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-416a2590-6a42-4a32-a922-a9d5f95786d6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.812401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-416a2590-6a42-4a32-a922-a9d5f95786d6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.812553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-416a2590-6a42-4a32-a922-a9d5f95786d6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.812642] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('416a2590-6a42-4a32-a922-a9d5f95786d6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.034529] env[65102]: INFO networking_nsxv3.common.synchronization [req-7da009b5-f093-4f42-b344-dacc1167af45 req-c4c1c480-de01-46a9-9e97-f797acb229ff tempest-ServerDiskConfigTestJSON-1771527805 tempest-ServerDiskConfigTestJSON-1771527805-project-member] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 999.035193] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 999.036682] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.036682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.036682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.036682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.036682] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.036682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.036682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.037308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.037308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.037308] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.067946] env[65102]: INFO networking_nsxv3.common.synchronization [None req-3f8826c1-696e-4e5c-bf52-714aaef00d44 None None] Enqueued Resource ID: d6cfb264-33bd-4e62-8f2a-6d19e217c9b2 with Priority: HIGHEST for action port [ 999.068499] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6cfb264-33bd-4e62-8f2a-6d19e217c9b2 with Priority: HIGHEST for action port [ 999.068869] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6cfb264-33bd-4e62-8f2a-6d19e217c9b2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.068985] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6cfb264-33bd-4e62-8f2a-6d19e217c9b2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.070152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6cfb264-33bd-4e62-8f2a-6d19e217c9b2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.070152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6cfb264-33bd-4e62-8f2a-6d19e217c9b2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.070152] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6cfb264-33bd-4e62-8f2a-6d19e217c9b2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.183717] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 in Status: SUCCESS [ 999.184088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.317374] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 416a2590-6a42-4a32-a922-a9d5f95786d6 with status ACTIVE [ 999.317374] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.317374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.317374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.317374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.317374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.317374] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.317374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.317374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.317374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.317374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.317374] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.317374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.317374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.317374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.318738] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.318738] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 416a2590-6a42-4a32-a922-a9d5f95786d6 is going to be updated. [ 999.318738] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.318887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.344120] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.344321] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.344407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.344676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.344819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.344982] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-416a2590-6a42-4a32-a922-a9d5f95786d6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.542329] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.542529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.542606] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.542823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.542921] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.543141] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.543260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.543327] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.543482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.543558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.543665] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 999.574497] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6cfb264-33bd-4e62-8f2a-6d19e217c9b2 [ 999.575810] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.576195] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.576195] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.576357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.576451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.576562] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6cfb264-33bd-4e62-8f2a-6d19e217c9b2 already deleted. [ 999.576648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6cfb264-33bd-4e62-8f2a-6d19e217c9b2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.586591] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.586591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.586591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.586591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.586591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.594518] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 999.646511] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 999.646511] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 deletion is rescheduled due to dependency. [ 999.646511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.646511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.646511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.646511] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.646511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.646511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.647045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.647045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.647045] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.149481] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.657677] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.158492] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.158793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.158912] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.159326] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.159494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.159667] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be updated. [ 1001.193256] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.193436] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.193760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.193760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.193904] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.205372] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: IN_PROGRESS for 2s [ 1001.501075] env[65102]: INFO networking_nsxv3.common.synchronization [None req-9b627c46-1e73-407d-a2b3-7475ddff35e9 None None] Enqueued Resource ID: 130d1aaa-5ab4-45c3-ae40-82c72de015cd with Priority: HIGHEST for action port [ 1001.502129] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 130d1aaa-5ab4-45c3-ae40-82c72de015cd with Priority: HIGHEST for action port [ 1001.502129] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-130d1aaa-5ab4-45c3-ae40-82c72de015cd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.502129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-130d1aaa-5ab4-45c3-ae40-82c72de015cd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.502482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-130d1aaa-5ab4-45c3-ae40-82c72de015cd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.502630] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-130d1aaa-5ab4-45c3-ae40-82c72de015cd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.502686] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('130d1aaa-5ab4-45c3-ae40-82c72de015cd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.607414] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 1001.607414] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f deletion is rescheduled due to dependency. [ 1001.607647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.005307] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 130d1aaa-5ab4-45c3-ae40-82c72de015cd [ 1002.005605] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.005714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.005759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.005972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.006074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.006170] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:130d1aaa-5ab4-45c3-ae40-82c72de015cd already deleted. [ 1002.006250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-130d1aaa-5ab4-45c3-ae40-82c72de015cd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.773260] env[65102]: INFO networking_nsxv3.common.synchronization [req-8e628dfe-cd8f-4c32-a44d-ef207705ffdf req-84ea528c-f33c-42ff-a96d-83d5a754a6dc tempest-ImagesTestJSON-2026451637 tempest-ImagesTestJSON-2026451637-project-member] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 1002.774115] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 1002.774555] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.774735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.774834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.775126] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.775352] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.775562] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.775625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.776135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.776288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.776435] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.216420] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 1003.216789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.216851] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.217176] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.217425] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.218209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.218469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.219180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.219567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.219789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.220069] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.280819] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.280819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.280819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.281307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.281307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.281307] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.281307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.281626] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.281626] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.281626] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.281787] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be updated. [ 1003.314939] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.314939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.314939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.314939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.314939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.326150] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 1003.636819] env[65102]: INFO networking_nsxv3.common.synchronization [req-4a7492f9-2eff-4aec-a2f9-99f291370554 req-84999922-d815-4fff-9241-0810fd8b5df1 tempest-ServersAdminNegativeTestJSON-1381091624 tempest-ServersAdminNegativeTestJSON-1381091624-project-member] Enqueued Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_members [ 1003.637553] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_members [ 1003.638022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.638150] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.638200] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.638374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.638529] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.638655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.638704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.638854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.638946] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.639061] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.726085] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.142282] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.227909] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0212d5d1-3785-49e1-b4e8-aaad4f538d18: rpc.has_security_group_logging(os_id): False [ 1004.249999] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.250174] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.250237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.250452] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.250543] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.250783] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.250877] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.250945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.251104] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.251183] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.251270] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be updated. [ 1004.341154] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.341365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.341365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.341576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.341725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.356027] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: IN_PROGRESS for 2s [ 1004.648111] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.150648] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.150839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.150839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.151158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.151254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.151327] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd79c243-92bc-47a2-80ad-114091c4bab9 is going to be updated. [ 1005.204082] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.204082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.204082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.204082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.204082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.217217] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: IN_PROGRESS for 2s [ 1005.352186] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 1005.352501] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad deletion is rescheduled due to dependency. [ 1005.352501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.220504] env[65102]: INFO networking_nsxv3.common.synchronization [None req-a7086e28-da16-4f45-94d9-ae6891dea17f tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 with Priority: HIGHEST for action security_group_rules [ 1006.221743] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 with Priority: HIGHEST for action security_group_rules [ 1006.222282] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6a6e2c1-d834-4eaf-b515-26c83f090350 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.222282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.222282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.222798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.223151] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6a6e2c1-d834-4eaf-b515-26c83f090350',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.324376] env[65102]: INFO networking_nsxv3.common.synchronization [None req-3a09cdd5-8620-4efb-84f0-562badabd58e tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 with Priority: HIGHEST for action security_group_rules [ 1006.324971] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 with Priority: HIGHEST for action security_group_rules [ 1006.325814] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6a6e2c1-d834-4eaf-b515-26c83f090350 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.326030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.383293] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 1006.384228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.523313] env[65102]: INFO networking_nsxv3.common.synchronization [req-9adc7b05-f4b6-4c1e-b322-c9e0d4a75c62 req-d7dba7b7-dcd0-4fa9-91a3-24b6975caf1a tempest-ServerAddressesNegativeTestJSON-1826277776 tempest-ServerAddressesNegativeTestJSON-1826277776-project-member] Enqueued Resource ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 with Priority: HIGHEST for action security_group_members [ 1006.524416] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 with Priority: HIGHEST for action security_group_members [ 1006.525165] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.525290] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.525509] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.525807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.525977] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.526092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.526156] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.526306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.526397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.526493] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.757758] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.757983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.758083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.758298] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.758465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.758586] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 already deleted. [ 1006.758684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.758905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.759188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.759701] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6a6e2c1-d834-4eaf-b515-26c83f090350',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.029795] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.030036] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.030036] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.032409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.032532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.032744] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.032856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.032937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.033103] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.033184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.033272] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 is going to be updated. [ 1007.067495] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.067495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.067748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.067811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.067998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.077938] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 in Status: IN_PROGRESS for 2s [ 1007.226683] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: IN_PROGRESS for 4s [ 1007.287618] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.287618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.287618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.287618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.287856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.287856] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 already deleted. [ 1007.287856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.087842] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 in Status: SUCCESS [ 1009.088283] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 deletion is rescheduled due to dependency. [ 1009.088283] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.236682] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: SUCCESS [ 1009.236900] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.252153] env[65102]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1010.252441] env[65102]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1011.525478] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1011.525899] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1014.527751] env[65102]: INFO networking_nsxv3.common.synchronization [req-66b630c8-0437-497e-a037-4b0ce08b6077 req-367a873f-0518-4bec-b498-5d9e13f200b4 tempest-DeleteServersTestJSON-1773899535 tempest-DeleteServersTestJSON-1773899535-project-member] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 1014.528349] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 1014.528990] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.529146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.529218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.529436] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.529597] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.529696] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.529757] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.529900] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.529986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.530088] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.838315] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.838602] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.838750] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.839039] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.839311] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.839470] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.839590] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.839884] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.840055] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.840210] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.840320] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.840426] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.840535] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.840688] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1014.840804] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.840860] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.862631] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.862862] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1014.863059] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.863573] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.863689] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-d252ac0c-f7eb-4a04-8af4-7b1eb031aa93 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.863909] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-d252ac0c-f7eb-4a04-8af4-7b1eb031aa93" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.864087] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-d252ac0c-f7eb-4a04-8af4-7b1eb031aa93" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.864447] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-d252ac0c-f7eb-4a04-8af4-7b1eb031aa93" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.864629] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d252ac0c-f7eb-4a04-8af4-7b1eb031aa93',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.033926] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.034133] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.034209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.034468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.034583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.034814] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.034921] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.034988] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.035172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.035249] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.035408] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 1015.064602] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.064824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.064951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.065248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.065416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.075317] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 1015.367144] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.367379] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.367435] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.367743] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.367898] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.368077] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port d252ac0c-f7eb-4a04-8af4-7b1eb031aa93 not found, creating... [ 1015.368382] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.368585] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.368709] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.368955] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.369106] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.369605] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.369806] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.369928] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.370163] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.370302] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.370444] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: d252ac0c-f7eb-4a04-8af4-7b1eb031aa93 is going to be created. [ 1015.392991] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.393236] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.393354] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.393713] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.393991] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.394249] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-d252ac0c-f7eb-4a04-8af4-7b1eb031aa93" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.111979] env[65102]: INFO networking_nsxv3.common.synchronization [req-66b630c8-0437-497e-a037-4b0ce08b6077 req-1ffe5618-942d-46ab-a401-f1f505efd648 service nova] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_rules [ 1016.112419] env[65102]: INFO networking_nsxv3.common.synchronization [req-66b630c8-0437-497e-a037-4b0ce08b6077 req-1ffe5618-942d-46ab-a401-f1f505efd648 service nova] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 1016.112696] env[65102]: INFO networking_nsxv3.common.synchronization [req-66b630c8-0437-497e-a037-4b0ce08b6077 req-1ffe5618-942d-46ab-a401-f1f505efd648 service nova] Enqueued Resource ID: d252ac0c-f7eb-4a04-8af4-7b1eb031aa93 with Priority: HIGHEST for action port [ 1016.113163] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_rules [ 1016.113325] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 1016.113436] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d252ac0c-f7eb-4a04-8af4-7b1eb031aa93 with Priority: HIGHEST for action port [ 1016.113769] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.113939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.114022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.114267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.114352] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.115978] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.116133] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.116427] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d252ac0c-f7eb-4a04-8af4-7b1eb031aa93 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.116794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d252ac0c-f7eb-4a04-8af4-7b1eb031aa93" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.116794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d252ac0c-f7eb-4a04-8af4-7b1eb031aa93" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.116893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d252ac0c-f7eb-4a04-8af4-7b1eb031aa93" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.116997] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d252ac0c-f7eb-4a04-8af4-7b1eb031aa93',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.617934] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.618130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.621022] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d252ac0c-f7eb-4a04-8af4-7b1eb031aa93 with status ACTIVE [ 1016.621022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.621022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.621022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.621022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.621022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.621022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.621022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.621022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.621022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.621022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.621022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.621022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.621022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.621022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.621022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.621022] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d252ac0c-f7eb-4a04-8af4-7b1eb031aa93 is going to be updated. [ 1016.646077] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.646257] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.646257] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.646436] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.646667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.646884] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d252ac0c-f7eb-4a04-8af4-7b1eb031aa93" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.089291] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 1017.089557] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f deletion is rescheduled due to dependency. [ 1017.089680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.089931] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.090227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.090447] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.090603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.090719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.090866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.090950] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.091066] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.593543] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.095767] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.599081] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.602533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.602533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.602533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.602533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.602533] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 1018.633858] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.633858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.633858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.633858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.633858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.643544] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 1019.848200] env[65102]: INFO networking_nsxv3.common.synchronization [req-c8829330-2052-445b-af24-917b90917d61 req-0ada4ade-d0ac-4226-b9d7-b460f0f6d988 tempest-ServerDiskConfigTestJSON-1771527805 tempest-ServerDiskConfigTestJSON-1771527805-project-member] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1019.848200] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1019.848200] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.848806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.848806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.848806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.848806] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.848806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.848806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.849035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.849304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.850016] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.213755] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-312 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.213890] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.213963] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.214235] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.214812] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.215054] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.215132] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.215570] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.215570] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.215730] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.215893] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.215963] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.216027] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.216225] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.216298] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.216445] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.239466] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.239683] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.239825] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.240013] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.240376] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-d88e66c9-ba7c-452d-8e44-8c9603f2b258 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.240648] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-d88e66c9-ba7c-452d-8e44-8c9603f2b258" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.240821] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-d88e66c9-ba7c-452d-8e44-8c9603f2b258" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.241161] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-d88e66c9-ba7c-452d-8e44-8c9603f2b258" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.241346] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d88e66c9-ba7c-452d-8e44-8c9603f2b258',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.351512] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.351512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.351512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.351801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.351801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.351992] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.352116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.352158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.352349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.352432] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.352890] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 1020.381910] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.382208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.382296] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.382560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.382718] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.392490] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 1020.655978] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 1020.656262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.656457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.656725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.656961] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.657155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.657225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.657423] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.657512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.657600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.657695] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.743909] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.744169] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.744169] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.744403] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.744556] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.744787] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port d88e66c9-ba7c-452d-8e44-8c9603f2b258 not found, creating... [ 1020.746199] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.746199] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.746199] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.746199] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.746199] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.746505] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.746838] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.746967] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.747216] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.747443] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.747600] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: d88e66c9-ba7c-452d-8e44-8c9603f2b258 is going to be created. [ 1020.768318] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.768590] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.768715] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.768997] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.769285] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.769533] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-d88e66c9-ba7c-452d-8e44-8c9603f2b258" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.160746] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.161089] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.161089] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.161258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.161464] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.161654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.161654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.161836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.161907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.162013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.162206] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.162467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.162467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.162579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.162652] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.162814] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.162889] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.163056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.163141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.163233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.163331] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.479030] env[65102]: INFO networking_nsxv3.common.synchronization [req-c8829330-2052-445b-af24-917b90917d61 req-c81ab64a-76dc-43ba-8249-29360c508d9a service nova] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_rules [ 1021.479030] env[65102]: INFO networking_nsxv3.common.synchronization [req-c8829330-2052-445b-af24-917b90917d61 req-c81ab64a-76dc-43ba-8249-29360c508d9a service nova] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1021.479030] env[65102]: INFO networking_nsxv3.common.synchronization [req-c8829330-2052-445b-af24-917b90917d61 req-c81ab64a-76dc-43ba-8249-29360c508d9a service nova] Enqueued Resource ID: d88e66c9-ba7c-452d-8e44-8c9603f2b258 with Priority: HIGHEST for action port [ 1021.479030] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_rules [ 1021.479030] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1021.479030] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d88e66c9-ba7c-452d-8e44-8c9603f2b258 with Priority: HIGHEST for action port [ 1021.479793] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.480075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.480246] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.480544] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.480823] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.481805] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.482145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.482722] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d88e66c9-ba7c-452d-8e44-8c9603f2b258 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.482722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d88e66c9-ba7c-452d-8e44-8c9603f2b258" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.482722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d88e66c9-ba7c-452d-8e44-8c9603f2b258" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.482949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d88e66c9-ba7c-452d-8e44-8c9603f2b258" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.482949] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d88e66c9-ba7c-452d-8e44-8c9603f2b258',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.666614] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99c8f96e-2cdb-49cd-8847-bf7698ff539f: rpc.has_security_group_logging(os_id): False [ 1021.684999] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.685196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.685241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.685427] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.685515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.685733] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.685828] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.685890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.687062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.687062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.687062] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.687062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.687062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.687062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.687062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.687062] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.687062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.687062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.687721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.687721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.687721] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 1021.747748] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.747748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.747748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.747987] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.747987] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.766090] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 1021.984674] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.984674] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.988219] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d88e66c9-ba7c-452d-8e44-8c9603f2b258 with status ACTIVE [ 1021.988688] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.988688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.988688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.988866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.988866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.989558] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.989558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.989558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.989558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.989558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.989764] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.989868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.989940] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.990183] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.990183] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.990266] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d88e66c9-ba7c-452d-8e44-8c9603f2b258 is going to be updated. [ 1022.010761] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.010761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.010937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.011101] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.011177] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.011341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d88e66c9-ba7c-452d-8e44-8c9603f2b258" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.403383] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 1022.403724] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f deletion is rescheduled due to dependency. [ 1022.403785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.403981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.404481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.404699] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.404840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.404914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.405140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.405254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.405355] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.907366] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.409841] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.781228] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 1023.781502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.912511] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.912669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.912740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.912980] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.913113] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.913188] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 1023.951187] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.951330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.951379] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.952240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.952406] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.963596] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 1024.233264] env[65102]: INFO networking_nsxv3.common.synchronization [req-07682a2f-9adb-4a6f-b705-3ba5dbdc2a94 req-4f51ec9b-3e7d-479f-923d-2901658370f4 tempest-ImagesTestJSON-2026451637 tempest-ImagesTestJSON-2026451637-project-member] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 1024.233564] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 1024.234263] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.234819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.234819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.234941] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.235102] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.235905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.235905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.235905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.235905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.235905] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.599447] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.599853] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.599853] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.600054] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.600325] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.601037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.601037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.601037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.601037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.601284] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.601424] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.601530] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.601637] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.601759] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.601863] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.602007] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.623852] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.624017] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1024.624229] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.624406] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-557" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.624733] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-4fe4b3ad-385c-4532-8edc-066c218ced49 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.624932] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-4fe4b3ad-385c-4532-8edc-066c218ced49" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.625051] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-4fe4b3ad-385c-4532-8edc-066c218ced49" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.625382] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-4fe4b3ad-385c-4532-8edc-066c218ced49" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.625895] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fe4b3ad-385c-4532-8edc-066c218ced49',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.737955] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.738164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.738242] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.738463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.738550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.738792] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.738911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.738984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.739312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.739417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.739511] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be updated. [ 1024.768023] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.768280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.768337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.768544] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.768697] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.781050] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 1025.130052] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.130052] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.130052] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.130052] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.130459] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.130459] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 4fe4b3ad-385c-4532-8edc-066c218ced49 not found, creating... [ 1025.130753] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.131035] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.131404] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.132915] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.133226] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.134276] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.134276] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.134276] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.134429] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.134571] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.134771] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 4fe4b3ad-385c-4532-8edc-066c218ced49 is going to be created. [ 1025.162041] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.162041] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.162041] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.162041] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.162438] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.162515] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-4fe4b3ad-385c-4532-8edc-066c218ced49" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.872322] env[65102]: INFO networking_nsxv3.common.synchronization [req-07682a2f-9adb-4a6f-b705-3ba5dbdc2a94 req-49a9ce02-43a6-454b-a8f0-b015e038de6e service nova] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_rules [ 1025.872322] env[65102]: INFO networking_nsxv3.common.synchronization [req-07682a2f-9adb-4a6f-b705-3ba5dbdc2a94 req-49a9ce02-43a6-454b-a8f0-b015e038de6e service nova] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 1025.872322] env[65102]: INFO networking_nsxv3.common.synchronization [req-07682a2f-9adb-4a6f-b705-3ba5dbdc2a94 req-49a9ce02-43a6-454b-a8f0-b015e038de6e service nova] Enqueued Resource ID: 4fe4b3ad-385c-4532-8edc-066c218ced49 with Priority: HIGHEST for action port [ 1025.872747] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_rules [ 1025.872747] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 1025.872747] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fe4b3ad-385c-4532-8edc-066c218ced49 with Priority: HIGHEST for action port [ 1025.873458] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.873458] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.873458] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.873458] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.873458] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.874675] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.874675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.874837] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fe4b3ad-385c-4532-8edc-066c218ced49 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.874837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fe4b3ad-385c-4532-8edc-066c218ced49" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.874934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fe4b3ad-385c-4532-8edc-066c218ced49" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.875133] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fe4b3ad-385c-4532-8edc-066c218ced49" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.875235] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fe4b3ad-385c-4532-8edc-066c218ced49',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.978061] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 1025.978272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.978462] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.978689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.978902] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.979041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.979121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.979307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.979437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.979599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.979656] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.265861] env[65102]: INFO networking_nsxv3.common.synchronization [req-69aca552-3f3a-4da8-b787-b73aebd1dc66 req-be0fc1a9-320a-482a-bf5d-f4e2029d947b tempest-ServersTestJSON-191426844 tempest-ServersTestJSON-191426844-project-member] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1026.266581] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1026.267344] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.267497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.267565] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.267983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.268185] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.268658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.268789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.268961] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.269062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.269258] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.377407] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.377503] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.379883] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4fe4b3ad-385c-4532-8edc-066c218ced49 with status ACTIVE [ 1026.380099] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.380228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.380330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.380548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.380672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.380847] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.380897] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.380969] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.381150] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.381232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.381415] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.381507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.381566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.381699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.381770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.381852] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4fe4b3ad-385c-4532-8edc-066c218ced49 is going to be updated. [ 1026.406919] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.407078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.407152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.407353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.408698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.408698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fe4b3ad-385c-4532-8edc-066c218ced49" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.486865] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.486865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.486865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.486865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.486865] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.486865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.486865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.486865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.486865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.487532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.487532] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.487532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.487532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.487532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.487718] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.487718] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.487718] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.487824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.487911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.488284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.488397] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.606854] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.607152] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.607285] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.607659] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.607984] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.608227] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.608295] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.608530] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.608677] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.608950] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.609112] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.609210] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.609337] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.609458] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.609578] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.609715] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.630190] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.630379] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1026.630521] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.630704] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.631061] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.631265] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.631355] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.631667] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.631798] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.771519] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.771686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.771760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.771983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.772087] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.772291] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.772390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.772451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.772597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.772671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.772754] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 already deleted. [ 1026.772835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.791483] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 1026.791671] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad deletion is rescheduled due to dependency. [ 1026.791785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.791947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.792187] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.792396] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.792506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.792568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.792784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.792825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.792885] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.990391] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a0c01bc-dc67-4824-bf8b-60c7f41f292f: rpc.has_security_group_logging(os_id): False [ 1027.009318] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.009611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.009611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.009802] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.009947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.010216] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.010337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.010408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.010565] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.010646] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.010877] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.011044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.011155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.011243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.011322] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.011506] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.011601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.011660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.011800] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.011874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.011962] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 1027.087427] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.087610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.087672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.087854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.088154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.103702] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 1027.134071] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.134336] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.134637] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.134873] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.134873] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.135072] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87 not found, creating... [ 1027.135334] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.135443] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.135566] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.135922] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.136161] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.136443] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.136596] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.136729] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.136917] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.137103] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.137200] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87 is going to be created. [ 1027.161531] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.161531] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.161817] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.161995] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.162355] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.162627] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.295481] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.798393] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.852433] env[65102]: INFO networking_nsxv3.common.synchronization [req-69aca552-3f3a-4da8-b787-b73aebd1dc66 req-d5331964-ea9e-4ff3-b787-b8a48033c894 service nova] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_rules [ 1027.852684] env[65102]: INFO networking_nsxv3.common.synchronization [req-69aca552-3f3a-4da8-b787-b73aebd1dc66 req-d5331964-ea9e-4ff3-b787-b8a48033c894 service nova] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1027.852835] env[65102]: INFO networking_nsxv3.common.synchronization [req-69aca552-3f3a-4da8-b787-b73aebd1dc66 req-d5331964-ea9e-4ff3-b787-b8a48033c894 service nova] Enqueued Resource ID: 966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87 with Priority: HIGHEST for action port [ 1027.853406] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_rules [ 1027.853622] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1027.853761] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87 with Priority: HIGHEST for action port [ 1027.854391] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.854490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.854541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.855874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.855874] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.855874] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.856147] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.856147] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.856330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.856636] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.856636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.856636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.856795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.856795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.856871] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.859572] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.860096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.860096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.860096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.860096] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.266837] env[65102]: INFO networking_nsxv3.common.synchronization [req-a5272568-fdce-4582-8845-5f4e59b4656c req-d6ed860a-94d7-4538-a9be-898f596888eb tempest-ServersV294TestFqdnHostnames-1427429126 tempest-ServersV294TestFqdnHostnames-1427429126-project-member] Enqueued Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGHEST for action security_group_members [ 1028.267657] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGHEST for action security_group_members [ 1028.268288] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29f22186-8565-4d84-ad72-633756f6f315 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.268760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.268891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.269064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.269452] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.269452] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.269452] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.269652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.269652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.269727] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29f22186-8565-4d84-ad72-633756f6f315',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.300899] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.301260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.301260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.301487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.301606] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.301682] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be updated. [ 1028.332971] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.333213] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.333288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.333507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.333659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.342089] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 1028.361975] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.364144] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.364144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.364144] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87 with status ACTIVE [ 1028.364144] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.364144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.364491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.364491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.364491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.364676] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.364794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.364835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.365042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.365129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.365427] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.365427] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.365515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.365794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.366162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.366162] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87 is going to be updated. [ 1028.387451] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.387451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.387451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.387760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.387760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.387988] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-966ebe8f-6f1a-49a5-b3bf-1a1bf51f8c87" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.773384] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.773384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.773384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.773384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.795774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.796049] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.796269] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.796336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.796531] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.796734] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.796830] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29f22186-8565-4d84-ad72-633756f6f315 is going to be updated. [ 1028.824632] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.824830] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.824893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.825093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.825257] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.834423] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29f22186-8565-4d84-ad72-633756f6f315 in Status: IN_PROGRESS for 2s [ 1028.864914] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.120358] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 1029.120928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.364960] env[65102]: INFO networking_nsxv3.common.synchronization [req-060c7414-f8c7-49c7-b696-09043bd1c093 req-7f670a7b-a120-455b-955c-6fdac13bc3c9 tempest-DeleteServersTestJSON-1773899535 tempest-DeleteServersTestJSON-1773899535-project-member] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 1029.365435] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 1029.365845] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.367282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.367282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.367282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.367282] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.367282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.367282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.367637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.367637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.367637] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.369332] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.369515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.369578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.370360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.370360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.370360] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be created. [ 1029.400367] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.400489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.400532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.400939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.401034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.417313] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: UNINITIALIZED for 2s [ 1029.874221] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.874408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.874492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.874733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.874859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.875316] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.875993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.875993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.876685] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.876788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.876911] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 1029.914157] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.914469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.914469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.914675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.914845] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.924530] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 1030.352669] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 1030.352977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.353293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.353576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.353843] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.354049] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.354139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.354394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.354508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.354602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.354705] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.845800] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29f22186-8565-4d84-ad72-633756f6f315 in Status: SUCCESS [ 1030.846167] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29f22186-8565-4d84-ad72-633756f6f315 deletion is rescheduled due to dependency. [ 1030.846167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.857965] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.858452] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.858588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.858904] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.859222] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.859350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.859417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.859646] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.859739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.859867] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.860091] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.860228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.860296] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.860448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.860596] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.860689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.860750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.860907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.861067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.861254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.861375] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.364479] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad: rpc.has_security_group_logging(os_id): False [ 1031.384698] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.384844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.384912] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.385140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.385232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.385453] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.385550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.385611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.385782] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.385862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.386700] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.386700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.386700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.386700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.386700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.386700] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.386700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.386700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.387377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.387377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.387377] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be updated. [ 1031.426235] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1031.426481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.427548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.427548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.427675] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.427816] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.427955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.428141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.428257] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.428370] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.428485] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.463276] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.463434] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.463506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.463733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.463916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.481819] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 1031.930975] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.931357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.931357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.931440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.931594] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.931690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.931750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.932029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.932029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.932131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.932206] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.932297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.932355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.932489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.932695] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.932695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.932784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.932872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.932971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.933024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.933114] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.939665] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 1031.939884] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f deletion is rescheduled due to dependency. [ 1031.940021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.435438] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8746f52-1411-469d-8df9-8b15536649f6: rpc.has_security_group_logging(os_id): False [ 1032.456025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.456217] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.456291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.456524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.456657] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.456893] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.457017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.457080] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.457268] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.457348] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.457546] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.457705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.457775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.457938] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.458027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.458258] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.458351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.458430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.458572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.458669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.458773] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be created. [ 1032.516393] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.516617] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.516617] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.516807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.516988] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.527915] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1032.767057] env[65102]: INFO networking_nsxv3.common.synchronization [req-d6f415f8-9dca-4374-911c-53af96ae967e req-69f3ac0e-0570-4d13-97f2-d58cc6c217ce tempest-ServersAdminNegativeTestJSON-1381091624 tempest-ServersAdminNegativeTestJSON-1381091624-project-member] Enqueued Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_members [ 1032.767683] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGHEST for action security_group_members [ 1032.767991] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.768175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.768283] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.768513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.768903] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.768903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.768903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.769147] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.769292] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.769435] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.272135] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.272135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.272135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.272135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.272135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.272702] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.272702] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.272702] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.272702] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.272702] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.272954] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd79c243-92bc-47a2-80ad-114091c4bab9 is going to be updated. [ 1033.303907] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.303907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.303907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.305134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.305134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.315098] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: IN_PROGRESS for 2s [ 1033.498327] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 1033.498560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.408785] env[65102]: INFO networking_nsxv3.common.synchronization [req-04a81454-49ed-4a23-90a9-6c65da3b350b req-1e2f8607-f2e0-4bc9-a02f-48753c8dc161 tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1034.409376] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1034.409651] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.409771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.409826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.410030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.410211] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.410310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.410404] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.410474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.410557] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.410646] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.543668] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1034.544776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.773475] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.773669] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.773795] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.774578] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.775862] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.777347] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.777515] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.777805] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.777970] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.778427] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.778427] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.778427] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.778632] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.778817] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.778930] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.779039] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.799980] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.800186] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1034.800350] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.800512] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.800825] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.801125] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.801125] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.801458] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.801597] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.915478] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.915478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.915478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.915478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.936097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.936437] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.936568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.936639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.936859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.936988] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.937056] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1034.964216] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.964422] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.964504] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.964705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.964852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.975227] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1035.307282] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.307282] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.307282] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.307282] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.307282] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.307282] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4 not found, creating... [ 1035.307589] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.307808] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.308791] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.308791] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.308791] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.308791] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.308791] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.309267] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.310579] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.313739] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.314039] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4 is going to be created. [ 1035.327878] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd79c243-92bc-47a2-80ad-114091c4bab9 in Status: SUCCESS [ 1035.328124] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd79c243-92bc-47a2-80ad-114091c4bab9 deletion is rescheduled due to dependency. [ 1035.328266] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.374697] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.374950] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.375597] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.375597] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.375776] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.376044] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.062305] env[65102]: INFO networking_nsxv3.common.synchronization [req-04a81454-49ed-4a23-90a9-6c65da3b350b req-a21c58ea-2c84-4ccd-bb2a-fa69f636a292 service nova] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_rules [ 1036.062305] env[65102]: INFO networking_nsxv3.common.synchronization [req-04a81454-49ed-4a23-90a9-6c65da3b350b req-a21c58ea-2c84-4ccd-bb2a-fa69f636a292 service nova] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1036.062305] env[65102]: INFO networking_nsxv3.common.synchronization [req-04a81454-49ed-4a23-90a9-6c65da3b350b req-a21c58ea-2c84-4ccd-bb2a-fa69f636a292 service nova] Enqueued Resource ID: fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4 with Priority: HIGHEST for action port [ 1036.062961] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_rules [ 1036.062961] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1036.062961] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4 with Priority: HIGHEST for action port [ 1036.063144] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.063322] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.063322] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.063693] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.063693] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.065473] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.065784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.066030] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.066196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.066196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.066383] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.066476] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.566027] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.566244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.569751] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4 with status ACTIVE [ 1036.569868] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.569983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.569983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.570207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.570295] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.570499] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.570631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.570726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.570911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.570995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.571200] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.571300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.571356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.571502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.571617] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.571673] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4 is going to be updated. [ 1036.593653] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.593653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.593653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.593918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.593918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.594113] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbe601d0-6bb2-4d9d-b98a-8d174aa4a6f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.778349] env[65102]: INFO networking_nsxv3.common.synchronization [req-76c2f980-c06e-4c7f-8bc1-688a5fef9058 req-7a9bbe8a-ccd3-4718-88d6-e4f741b072cb tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 with Priority: HIGHEST for action security_group_members [ 1036.778349] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 with Priority: HIGHEST for action security_group_members [ 1036.778685] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6a6e2c1-d834-4eaf-b515-26c83f090350 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.778685] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.778685] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.778949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.779104] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.779218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.779517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.779517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.779517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.779746] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6a6e2c1-d834-4eaf-b515-26c83f090350',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.986079] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1036.986288] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f deletion is rescheduled due to dependency. [ 1036.986426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.986600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.986891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.987081] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.987197] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.987277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.987437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.987706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.987860] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.142456] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.142806] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.142919] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.143204] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.143472] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.143765] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.143765] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.144069] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.144213] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.144448] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.144652] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1037.144732] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1037.144950] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1037.145011] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.145133] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1037.145310] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1037.165611] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1037.165843] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1037.166018] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1037.166244] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.166609] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-96111c75-74f7-4496-9470-0972fef27f6f taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.166824] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-96111c75-74f7-4496-9470-0972fef27f6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.166989] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-96111c75-74f7-4496-9470-0972fef27f6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.167387] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-96111c75-74f7-4496-9470-0972fef27f6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.167573] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96111c75-74f7-4496-9470-0972fef27f6f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.285163] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.285525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.285525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.285778] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.285778] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.285902] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.285983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.286079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.286732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.286732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.286732] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 already deleted. [ 1037.286732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.491308] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.669606] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.669854] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.669979] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.670323] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.670483] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.670646] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 96111c75-74f7-4496-9470-0972fef27f6f not found, creating... [ 1037.670902] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.671068] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.671186] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.671406] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.671543] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.671826] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.671979] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.672107] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.672309] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.672475] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.672578] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 96111c75-74f7-4496-9470-0972fef27f6f is going to be created. [ 1037.692751] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.692969] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.693159] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.693435] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.693660] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.693882] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-96111c75-74f7-4496-9470-0972fef27f6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.993355] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.454048] env[65102]: INFO networking_nsxv3.common.synchronization [req-76c2f980-c06e-4c7f-8bc1-688a5fef9058 req-8100f20c-5301-496b-beef-1340a3a0174c service nova] Enqueued Resource ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 with Priority: HIGHEST for action security_group_rules [ 1038.454616] env[65102]: INFO networking_nsxv3.common.synchronization [req-76c2f980-c06e-4c7f-8bc1-688a5fef9058 req-8100f20c-5301-496b-beef-1340a3a0174c service nova] Enqueued Resource ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 with Priority: HIGHEST for action security_group_members [ 1038.454616] env[65102]: INFO networking_nsxv3.common.synchronization [req-76c2f980-c06e-4c7f-8bc1-688a5fef9058 req-8100f20c-5301-496b-beef-1340a3a0174c service nova] Enqueued Resource ID: 96111c75-74f7-4496-9470-0972fef27f6f with Priority: HIGHEST for action port [ 1038.454794] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 with Priority: HIGHEST for action security_group_rules [ 1038.454939] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 with Priority: HIGHEST for action security_group_members [ 1038.455042] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96111c75-74f7-4496-9470-0972fef27f6f with Priority: HIGHEST for action port [ 1038.455325] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6a6e2c1-d834-4eaf-b515-26c83f090350 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.455551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.455623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.455831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.455912] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6a6e2c1-d834-4eaf-b515-26c83f090350',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.456807] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6a6e2c1-d834-4eaf-b515-26c83f090350 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.456922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.456967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.457156] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.457309] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.457427] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.457493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.457639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.457708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.457809] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6a6e2c1-d834-4eaf-b515-26c83f090350',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.458614] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-96111c75-74f7-4496-9470-0972fef27f6f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.458725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96111c75-74f7-4496-9470-0972fef27f6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.458785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96111c75-74f7-4496-9470-0972fef27f6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.458925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96111c75-74f7-4496-9470-0972fef27f6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.459012] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96111c75-74f7-4496-9470-0972fef27f6f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.496108] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.496323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.496323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.496682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.496682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.496818] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1038.530301] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.530473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.530543] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.530733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.530865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.540614] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1038.808843] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-500 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.810019] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.810019] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.810395] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.810802] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.811812] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.811812] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.811812] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.811812] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.811812] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.812078] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.812078] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.812157] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.812325] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.812377] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.812468] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.834812] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.835424] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1038.835424] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.835424] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.835673] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-b6bba8b1-799c-4c2b-bd94-8726094948ee taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.835863] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.835984] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.836252] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.836387] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6bba8b1-799c-4c2b-bd94-8726094948ee',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.961022] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6a6e2c1-d834-4eaf-b515-26c83f090350',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.963506] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6a6e2c1-d834-4eaf-b515-26c83f090350 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.965410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.965410] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96111c75-74f7-4496-9470-0972fef27f6f with status ACTIVE [ 1038.965410] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.965410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.965410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.965410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.965410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.965410] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.965410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.965410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.966029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.966029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.966029] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.966029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.966029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.966274] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.966274] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.966463] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96111c75-74f7-4496-9470-0972fef27f6f is going to be updated. [ 1038.991316] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.991468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.991537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.991750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.991891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.992075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96111c75-74f7-4496-9470-0972fef27f6f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.340214] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.340459] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.340528] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.340834] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.340958] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.341270] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.341479] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.341607] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.341834] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.341973] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.342275] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.342434] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.342555] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.342770] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.342910] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.343068] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: b6bba8b1-799c-4c2b-bd94-8726094948ee is going to be updated. [ 1039.364351] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.364570] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.364699] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.364991] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.365277] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.365541] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.463871] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6a6e2c1-d834-4eaf-b515-26c83f090350',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.967116] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.967238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.967280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.968276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.968276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.968276] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 is going to be created. [ 1039.994053] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.994053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.994053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.994369] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.994482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.004702] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 in Status: UNINITIALIZED for 2s [ 1040.080754] env[65102]: INFO networking_nsxv3.common.synchronization [req-5fc157f3-815d-47fa-97bb-c51294c0a649 req-b5d47498-f4e8-47b3-94ea-90916339134b service nova] Enqueued Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_rules [ 1040.081057] env[65102]: INFO networking_nsxv3.common.synchronization [req-5fc157f3-815d-47fa-97bb-c51294c0a649 req-b5d47498-f4e8-47b3-94ea-90916339134b service nova] Enqueued Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_members [ 1040.081189] env[65102]: INFO networking_nsxv3.common.synchronization [req-5fc157f3-815d-47fa-97bb-c51294c0a649 req-b5d47498-f4e8-47b3-94ea-90916339134b service nova] Enqueued Resource ID: b6bba8b1-799c-4c2b-bd94-8726094948ee with Priority: HIGHEST for action port [ 1040.081748] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_rules [ 1040.081871] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_members [ 1040.081983] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6bba8b1-799c-4c2b-bd94-8726094948ee with Priority: HIGHEST for action port [ 1040.082266] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01880e80-b093-4590-b2d1-b15567f49135 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.082407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.082463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.082645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.082733] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.083790] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-01880e80-b093-4590-b2d1-b15567f49135 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.083937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.083999] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.084187] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.084386] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.084484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.084551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.084716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.084803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.084896] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.085637] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6bba8b1-799c-4c2b-bd94-8726094948ee taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.085785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.085840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.086156] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.086156] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6bba8b1-799c-4c2b-bd94-8726094948ee',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.553680] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1040.554071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.554071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.554919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.554919] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.554919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.554919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.554919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.554919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.555412] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.555412] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.589131] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.589131] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-01880e80-b093-4590-b2d1-b15567f49135 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.589131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.589131] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6bba8b1-799c-4c2b-bd94-8726094948ee with status ACTIVE [ 1040.589131] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.589131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.589573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.589573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.589573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.589573] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.589741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.589741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.589897] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.589966] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.590262] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.590262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.590348] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.590425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.590553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.590596] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6bba8b1-799c-4c2b-bd94-8726094948ee is going to be updated. [ 1040.612939] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.613120] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.613170] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.613799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.613799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.613799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6bba8b1-799c-4c2b-bd94-8726094948ee" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.057932] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.057932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.058446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.058446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.058446] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.058446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.058672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.058672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.058756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.058854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.058976] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.059085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.059203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.059284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.059425] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.059514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.059592] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.059701] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.059779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.059880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.059965] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.092951] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.142843] env[65102]: INFO networking_nsxv3.common.synchronization [None req-c0c891af-5198-4aa0-a393-6320522f9d60 tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1041.143718] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1041.144352] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.144465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.144573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.144833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.145068] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.145533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.145533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.145533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.145806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.145861] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.562842] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59c26ae1-e2ae-453d-a285-e702cf89832f: rpc.has_security_group_logging(os_id): False [ 1041.580984] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.580984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.580984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.581303] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.581303] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.581392] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.581514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.581576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.581688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.581767] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.581967] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.582073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.582130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.582345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.582345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.582516] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.582595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.582709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.582774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.582849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.582930] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1041.595330] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.595493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.595557] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.595737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.595826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.595922] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01880e80-b093-4590-b2d1-b15567f49135 is going to be updated. [ 1041.626971] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.627480] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.627480] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.627774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.627842] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.638095] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01880e80-b093-4590-b2d1-b15567f49135 in Status: IN_PROGRESS for 2s [ 1041.651021] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.662158] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.662158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.662158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.662423] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.662642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.695041] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1042.019784] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 in Status: SUCCESS [ 1042.020379] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.020379] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.020783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.021049] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.022068] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.022068] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.022068] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.022631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.022631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.022631] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6a6e2c1-d834-4eaf-b515-26c83f090350',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.153288] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.525471] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6a6e2c1-d834-4eaf-b515-26c83f090350',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.658589] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.658913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.658913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.659057] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.659134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.659262] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1042.691726] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.691898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.692011] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.692400] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.692498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.702628] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1043.029492] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6a6e2c1-d834-4eaf-b515-26c83f090350: rpc.has_security_group_logging(os_id): False [ 1043.092059] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.092059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.092059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.092059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.092059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.092059] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.092059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.092059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.092059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.092059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.092059] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 is going to be created. [ 1043.208332] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.208890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.208890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.208890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.209168] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.226949] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 in Status: IN_PROGRESS for 2s [ 1043.648345] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01880e80-b093-4590-b2d1-b15567f49135 in Status: SUCCESS [ 1043.648345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.648514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.648592] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.648789] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.648906] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.648972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.649175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.649262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.649351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.649444] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.710180] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1043.710620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.796925] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.797254] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.797463] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.797770] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.798763] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.798953] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.799084] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.799330] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.799539] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.799777] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1043.799892] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1043.800020] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1043.800522] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1043.800522] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1043.800522] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1043.800522] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1043.821109] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1043.821419] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1043.821627] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1043.821803] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.822245] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-57c8daf0-4e71-4f3e-8e92-cde14428fbe3 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.822478] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-57c8daf0-4e71-4f3e-8e92-cde14428fbe3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.822660] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-57c8daf0-4e71-4f3e-8e92-cde14428fbe3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.823012] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-57c8daf0-4e71-4f3e-8e92-cde14428fbe3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.823238] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57c8daf0-4e71-4f3e-8e92-cde14428fbe3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.152027] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.326484] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.326484] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.326484] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.327240] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.327240] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.327240] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 57c8daf0-4e71-4f3e-8e92-cde14428fbe3 not found, creating... [ 1044.327787] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.328072] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.328272] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.328624] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.328831] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.329327] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.329621] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.329782] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.330088] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.330285] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.330506] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 57c8daf0-4e71-4f3e-8e92-cde14428fbe3 is going to be created. [ 1044.358441] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.358754] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.358893] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.359228] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.359669] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.360039] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-57c8daf0-4e71-4f3e-8e92-cde14428fbe3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.656264] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01880e80-b093-4590-b2d1-b15567f49135: rpc.has_security_group_logging(os_id): False [ 1044.677081] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.677343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.677434] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.677751] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.677798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.678159] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.678310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.678383] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.678576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.678676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.678792] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01880e80-b093-4590-b2d1-b15567f49135 is going to be updated. [ 1044.714557] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1044.715056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.753369] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.753369] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.753521] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.753726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.753979] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.777679] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01880e80-b093-4590-b2d1-b15567f49135 in Status: IN_PROGRESS for 2s [ 1045.107596] env[65102]: INFO networking_nsxv3.common.synchronization [req-86f73216-c31e-48d1-80e9-ee1c1aea39fe req-be4a7e36-0a38-4e63-b4ea-2087dc501129 service nova] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_rules [ 1045.107596] env[65102]: INFO networking_nsxv3.common.synchronization [req-86f73216-c31e-48d1-80e9-ee1c1aea39fe req-be4a7e36-0a38-4e63-b4ea-2087dc501129 service nova] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1045.107596] env[65102]: INFO networking_nsxv3.common.synchronization [req-86f73216-c31e-48d1-80e9-ee1c1aea39fe req-be4a7e36-0a38-4e63-b4ea-2087dc501129 service nova] Enqueued Resource ID: 57c8daf0-4e71-4f3e-8e92-cde14428fbe3 with Priority: HIGHEST for action port [ 1045.107596] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_rules [ 1045.107596] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1045.109404] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57c8daf0-4e71-4f3e-8e92-cde14428fbe3 with Priority: HIGHEST for action port [ 1045.109813] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.109912] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.110094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.110230] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.110230] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.111217] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.111337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.111454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.111659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.112365] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.112365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.112365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.112365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.112634] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.112634] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.113670] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-57c8daf0-4e71-4f3e-8e92-cde14428fbe3 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.113777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57c8daf0-4e71-4f3e-8e92-cde14428fbe3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.113829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57c8daf0-4e71-4f3e-8e92-cde14428fbe3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.113976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57c8daf0-4e71-4f3e-8e92-cde14428fbe3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.114116] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57c8daf0-4e71-4f3e-8e92-cde14428fbe3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.242069] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 in Status: SUCCESS [ 1045.242069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.615840] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.615840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.615988] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.616906] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57c8daf0-4e71-4f3e-8e92-cde14428fbe3 with status ACTIVE [ 1045.617139] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.617248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.617319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.617522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.617614] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.618632] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.618632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.618632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.618632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.618632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.618632] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.618632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.618632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.618632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.619617] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.619617] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57c8daf0-4e71-4f3e-8e92-cde14428fbe3 is going to be updated. [ 1045.644941] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.645134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.645202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.645423] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.645660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.645898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57c8daf0-4e71-4f3e-8e92-cde14428fbe3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.121143] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.624645] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.624645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.624645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.624844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.624844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.624917] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1046.659297] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.659533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.659533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.659740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.659887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.670708] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1046.804445] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01880e80-b093-4590-b2d1-b15567f49135 in Status: SUCCESS [ 1046.804659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.682771] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1048.683060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.683177] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.683409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.683606] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.683726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.683792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.683947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.684068] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.684165] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.684262] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.190956] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.190956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.190956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.190956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.190956] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.191502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.191502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.191502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.191502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.191502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.191827] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.191966] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.192016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.192192] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.192356] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.192453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.192515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.192656] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.192734] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.192818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.193314] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.696594] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59c26ae1-e2ae-453d-a285-e702cf89832f: rpc.has_security_group_logging(os_id): False [ 1049.725868] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.726107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.726107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.726325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.726415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.726613] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.726715] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.726763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.726922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.727086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.727255] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.727352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.727415] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.727559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.727631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.727818] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.727910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.728031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.728152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.728230] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.728316] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1049.797445] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.797627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.797674] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.797867] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.798098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.815152] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1050.110610] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1050.110809] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1050.749439] env[65102]: INFO networking_nsxv3.common.synchronization [req-26adac00-26f6-4697-ab16-23f8461dd1d0 req-57e5ba4b-5cd9-4efd-b0d7-d8d4f5bfb4b7 tempest-ImagesTestJSON-2026451637 tempest-ImagesTestJSON-2026451637-project-member] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 1050.749439] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGHEST for action security_group_members [ 1050.749439] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.749439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.749439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.749439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.749439] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.749439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.749439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.749439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.749439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.749439] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.252582] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.252773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.252855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.253090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.253191] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.253477] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.253604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.253672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.253869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.253955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.254067] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be updated. [ 1051.293288] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.293288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.293288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.293288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.293288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.302308] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: IN_PROGRESS for 2s [ 1051.837319] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1051.837319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.312683] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad in Status: SUCCESS [ 1053.313025] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad deletion is rescheduled due to dependency. [ 1053.313025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.170421] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.170608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.170998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.170998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.171358] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.236753] env[65102]: INFO networking_nsxv3.common.synchronization [None req-d0216242-9d3e-427f-a1ce-f0d98d7bdc17 None None] Enqueued Resource ID: 5b200221-8810-4408-b23b-f0f93be555ff with Priority: HIGHEST for action port [ 1054.237419] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b200221-8810-4408-b23b-f0f93be555ff with Priority: HIGHEST for action port [ 1054.237731] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b200221-8810-4408-b23b-f0f93be555ff taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.237969] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b200221-8810-4408-b23b-f0f93be555ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.238135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b200221-8810-4408-b23b-f0f93be555ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.238419] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b200221-8810-4408-b23b-f0f93be555ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.238482] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b200221-8810-4408-b23b-f0f93be555ff',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.401201] env[65102]: INFO networking_nsxv3.common.synchronization [req-9275bcfe-9d18-410b-ba64-5d4843b1c585 req-19831082-f5c3-4d7d-8664-9e0a95ffce5b tempest-ServersTestJSON-191426844 tempest-ServersTestJSON-191426844-project-member] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1054.401757] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1054.402076] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.402202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.402266] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.402463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.402749] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.402749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.402879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.402933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.402974] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.403094] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.674407] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.745341] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b200221-8810-4408-b23b-f0f93be555ff [ 1054.745677] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.745822] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.745895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.746112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.746209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.746297] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b200221-8810-4408-b23b-f0f93be555ff already deleted. [ 1054.746380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b200221-8810-4408-b23b-f0f93be555ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.754824] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.755041] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.755174] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.755438] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.755702] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.755863] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.755981] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.757719] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.757991] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.758228] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.758366] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.758523] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.758931] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.758931] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.758931] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.760304] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.785857] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.786053] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1054.786201] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.786377] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.786704] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-2cf26308-e979-456c-92a8-f2bdf0d6948f taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.786964] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-2cf26308-e979-456c-92a8-f2bdf0d6948f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.787031] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-2cf26308-e979-456c-92a8-f2bdf0d6948f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.787356] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-2cf26308-e979-456c-92a8-f2bdf0d6948f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.787498] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cf26308-e979-456c-92a8-f2bdf0d6948f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.905775] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.177326] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.296063] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.296063] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.296063] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.296063] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.296433] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.296433] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 2cf26308-e979-456c-92a8-f2bdf0d6948f not found, creating... [ 1055.296617] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.296793] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.296918] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.297329] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.297329] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.297562] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.297941] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.297941] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.298088] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.298192] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.298303] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 2cf26308-e979-456c-92a8-f2bdf0d6948f is going to be created. [ 1055.326154] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.326154] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.326154] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.326154] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.326154] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.326154] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-2cf26308-e979-456c-92a8-f2bdf0d6948f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.408444] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.680768] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1055.680768] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1055.910886] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.911233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.911304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.911528] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.911616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.911718] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1055.947902] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.947902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.947902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.947902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.947902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.956236] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1056.070964] env[65102]: INFO networking_nsxv3.common.synchronization [req-9275bcfe-9d18-410b-ba64-5d4843b1c585 req-96e0d29c-2f07-48fe-b491-7d4a542cbc6f service nova] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_rules [ 1056.071166] env[65102]: INFO networking_nsxv3.common.synchronization [req-9275bcfe-9d18-410b-ba64-5d4843b1c585 req-96e0d29c-2f07-48fe-b491-7d4a542cbc6f service nova] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1056.071313] env[65102]: INFO networking_nsxv3.common.synchronization [req-9275bcfe-9d18-410b-ba64-5d4843b1c585 req-96e0d29c-2f07-48fe-b491-7d4a542cbc6f service nova] Enqueued Resource ID: 2cf26308-e979-456c-92a8-f2bdf0d6948f with Priority: HIGHEST for action port [ 1056.071548] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_rules [ 1056.071680] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1056.071822] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf26308-e979-456c-92a8-f2bdf0d6948f with Priority: HIGHEST for action port [ 1056.072350] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.072482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.072540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.072727] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.072945] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.073784] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.074091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.074166] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cf26308-e979-456c-92a8-f2bdf0d6948f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.074291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cf26308-e979-456c-92a8-f2bdf0d6948f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.074373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cf26308-e979-456c-92a8-f2bdf0d6948f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.075064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cf26308-e979-456c-92a8-f2bdf0d6948f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.075064] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cf26308-e979-456c-92a8-f2bdf0d6948f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.473364] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.473364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.473364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.473364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.485280] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1056.487827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.488711] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1056.523051] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.523241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.523293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.523483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.535665] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.536352] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1056.536454] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.536544] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1056.576565] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.576799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.578712] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.578879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.578962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.579163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.580881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.581068] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1056.583329] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cf26308-e979-456c-92a8-f2bdf0d6948f with status ACTIVE [ 1056.583329] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.583329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.583329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.583329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.583329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.583329] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.583329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.583329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.583329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.583329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.583329] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.584070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.584070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.584070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.584070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.584070] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cf26308-e979-456c-92a8-f2bdf0d6948f is going to be updated. [ 1056.604201] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.605046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.605046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.605046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.605046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.605046] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cf26308-e979-456c-92a8-f2bdf0d6948f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.683332] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.683332] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.684464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.684464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.684464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.684464] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1056.712218] env[65102]: INFO networking_nsxv3.common.synchronization [None req-c983fc1c-5d8c-4b73-91cf-0493affef55f None None] Enqueued Resource ID: 57ea7f5f-3902-40e7-9dfe-93662b908e33 with Priority: HIGHEST for action port [ 1056.712795] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ea7f5f-3902-40e7-9dfe-93662b908e33 with Priority: HIGHEST for action port [ 1056.713473] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-57ea7f5f-3902-40e7-9dfe-93662b908e33 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.713473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57ea7f5f-3902-40e7-9dfe-93662b908e33" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.713473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57ea7f5f-3902-40e7-9dfe-93662b908e33" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.713680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57ea7f5f-3902-40e7-9dfe-93662b908e33" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.713680] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57ea7f5f-3902-40e7-9dfe-93662b908e33',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.777376] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.777376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.777376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.777376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.777970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.778307] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1056.778412] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0212d5d1-3785-49e1-b4e8-aaad4f538d18', '29f22186-8565-4d84-ad72-633756f6f315', 'b07f4606-a04e-468f-8194-7420bcbd987d', 'ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad', 'be29eb73-d99e-4af1-ad2e-c5ce871f7807', 'f5a72f78-b26f-4670-a8f0-eea902ebea26', '44ad09c8-ee6b-4496-8939-cd6fba160843', '29d98990-b866-4c6c-b1d9-41effdf1076b', 'e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7', '22827242-8721-47c3-af39-c8697770577f', '14808516-a2e0-455d-83e1-fa5b5fe0e828', 'ce19aa8e-b26d-4484-8765-4894bdbb95a0', 'ad9ff44a-eecd-47a3-a497-f84ebc9294a5', '85b46990-bd7b-4abe-881c-9016519cf955', '59c26ae1-e2ae-453d-a285-e702cf89832f', 'c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14', 'e1e9f6d0-9fe0-49a8-a7c4-58871051f77d', '2bf5a5e9-3448-461d-8616-ceb9cef4d902', '687f9a90-8cf8-4c0f-bfe9-b1800ef9665c', 'c9efb249-50ca-405f-918d-507bd86040c4', '1e4d0983-93de-4906-b7b5-69591bafe0fd', '085dab98-e474-491b-84c3-9542fcfa6775', 'ad9e53d9-a7e1-4764-bc44-f35fa2308feb', '6a0c01bc-dc67-4824-bf8b-60c7f41f292f', '0c61af5d-d112-491b-97cd-9e037a2e5189', 'bd79c243-92bc-47a2-80ad-114091c4bab9', 'd9b36c7e-229d-48ea-b61f-94b35a51b7f4', 'e683108f-84a0-4d62-934c-58f2999656a4', 'c6a41d40-0a8b-401c-801a-f31f69ae007f', '01880e80-b093-4590-b2d1-b15567f49135', 'c1b926d4-3a35-4d53-823e-1d4fbac254ef', 'b55ab5c0-f0c2-4178-85f4-c461e1efe368', '5476d54c-8894-4aeb-b26c-f1637341e27f', '99c8f96e-2cdb-49cd-8847-bf7698ff539f', '2c6cdc2b-9511-477a-8ea2-7f547770beda', '5e0a8011-b557-40dd-b9b5-481c08d0040a', '48a0698b-8c00-4295-9ba0-bc4c6ebdca57', 'daef1b5a-f25a-405c-9f5a-58444ec5510f', 'a0bc7ffe-997e-4e93-849d-b293c0ee0e6a', 'a6a6e2c1-d834-4eaf-b515-26c83f090350', '082ce940-517e-4ecd-a42e-d7d185e47139', 'cef9ee3d-68cd-4411-ad09-df35823eb076', '220505b1-a182-4b77-b78e-66a35b312ba6', 'e8746f52-1411-469d-8df9-8b15536649f6', '351e6bc8-ffc9-4dca-ac8a-98595980ddc4', '1966cd49-8e43-4ab8-862a-7f66af79660a'} {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.778568] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1056.823581] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.823723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.823793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.827053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.827053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.827053] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1056.827053] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.827053] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1056.863512] env[65102]: INFO networking_nsxv3.common.synchronization [req-41c3c69f-a615-460a-b741-81ba7a6252bd req-549942fe-53e0-4a1d-b5b2-17baa0944df1 tempest-DeleteServersTestJSON-1773899535 tempest-DeleteServersTestJSON-1773899535-project-member] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 1056.864486] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 1056.864809] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.864946] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.865042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.865212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.865367] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.865464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.865524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.865672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.865757] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.865852] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.935597] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.935740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.935740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.936465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.936964] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.937247] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1056.937327] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1056.937401] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1056.937463] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1056.937541] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1056.937616] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGH for action security_group_rules [ 1056.937706] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGH for action security_group_rules [ 1056.937783] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGH for action security_group_rules [ 1056.937841] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGH for action security_group_rules [ 1056.937902] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGH for action security_group_rules [ 1056.938612] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGH for action security_group_rules [ 1056.938612] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGH for action security_group_rules [ 1056.938612] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGH for action security_group_rules [ 1056.938612] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 with Priority: HIGH for action security_group_rules [ 1056.938612] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 22827242-8721-47c3-af39-c8697770577f with Priority: HIGH for action security_group_rules [ 1056.938612] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGH for action security_group_rules [ 1056.938612] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 with Priority: HIGH for action security_group_rules [ 1056.938612] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 with Priority: HIGH for action security_group_rules [ 1056.938612] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 85b46990-bd7b-4abe-881c-9016519cf955 with Priority: HIGH for action security_group_rules [ 1056.938612] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGH for action security_group_rules [ 1056.938612] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGH for action security_group_rules [ 1056.938612] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d with Priority: HIGH for action security_group_rules [ 1056.938612] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 with Priority: HIGH for action security_group_rules [ 1056.939102] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c with Priority: HIGH for action security_group_rules [ 1056.939102] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c9efb249-50ca-405f-918d-507bd86040c4 with Priority: HIGH for action security_group_rules [ 1056.939102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.177716] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.177716] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.177716] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.178016] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.179575] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.179575] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.179575] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.179575] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.179575] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.179575] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.179954] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.179954] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.179954] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.179954] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.180103] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.180599] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.198578] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.198742] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.198880] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.199085] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-113" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.199413] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-9e9a520d-8984-4d4d-934b-f46dbdac5f4d taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.199587] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-9e9a520d-8984-4d4d-934b-f46dbdac5f4d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.199778] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-9e9a520d-8984-4d4d-934b-f46dbdac5f4d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.200141] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-9e9a520d-8984-4d4d-934b-f46dbdac5f4d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.200287] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e9a520d-8984-4d4d-934b-f46dbdac5f4d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.216530] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57ea7f5f-3902-40e7-9dfe-93662b908e33 [ 1057.216805] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.216941] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.217038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.217214] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.217303] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.217393] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57ea7f5f-3902-40e7-9dfe-93662b908e33 already deleted. [ 1057.217474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57ea7f5f-3902-40e7-9dfe-93662b908e33" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.368089] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.368267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.368344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.368579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.394408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.394596] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.394733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.394801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.394997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.395164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.395256] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 1057.423872] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.424040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.424896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.424896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.424896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.434568] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 1057.706169] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.706169] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.706169] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.706169] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.706169] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.708407] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 9e9a520d-8984-4d4d-934b-f46dbdac5f4d not found, creating... [ 1057.708407] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.708407] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.708407] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.708407] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.708407] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.708407] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.708407] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.708407] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.708407] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.708792] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.708792] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 9e9a520d-8984-4d4d-934b-f46dbdac5f4d is going to be created. [ 1057.730350] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.730350] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.730350] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.730917] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.730917] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.731080] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-9e9a520d-8984-4d4d-934b-f46dbdac5f4d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.968927] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1057.969179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.969352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.969577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.969791] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.969915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.969987] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.970164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.970244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.970347] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.459190] env[65102]: INFO networking_nsxv3.common.synchronization [req-41c3c69f-a615-460a-b741-81ba7a6252bd req-c64a5fb2-12db-4161-a257-3338966e7f4b service nova] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_rules [ 1058.459379] env[65102]: INFO networking_nsxv3.common.synchronization [req-41c3c69f-a615-460a-b741-81ba7a6252bd req-c64a5fb2-12db-4161-a257-3338966e7f4b service nova] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 1058.459517] env[65102]: INFO networking_nsxv3.common.synchronization [req-41c3c69f-a615-460a-b741-81ba7a6252bd req-c64a5fb2-12db-4161-a257-3338966e7f4b service nova] Enqueued Resource ID: 9e9a520d-8984-4d4d-934b-f46dbdac5f4d with Priority: HIGHEST for action port [ 1058.460220] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_rules [ 1058.460220] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 1058.460346] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e9a520d-8984-4d4d-934b-f46dbdac5f4d with Priority: HIGHEST for action port [ 1058.460434] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGH for action security_group_rules [ 1058.460602] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b07f4606-a04e-468f-8194-7420bcbd987d with Priority: HIGH for action security_group_rules [ 1058.460701] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 with Priority: HIGH for action security_group_rules [ 1058.461305] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGH for action security_group_rules [ 1058.461589] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9efb249-50ca-405f-918d-507bd86040c4 with Priority: HIGH for action security_group_rules [ 1058.461737] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c with Priority: HIGH for action security_group_rules [ 1058.461847] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 with Priority: HIGH for action security_group_rules [ 1058.461950] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d with Priority: HIGH for action security_group_rules [ 1058.462803] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85b46990-bd7b-4abe-881c-9016519cf955 with Priority: HIGH for action security_group_rules [ 1058.462803] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 with Priority: HIGH for action security_group_rules [ 1058.462803] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 with Priority: HIGH for action security_group_rules [ 1058.463035] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 with Priority: HIGH for action security_group_rules [ 1058.463035] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 with Priority: HIGH for action security_group_rules [ 1058.463118] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22827242-8721-47c3-af39-c8697770577f with Priority: HIGH for action security_group_rules [ 1058.463213] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 with Priority: HIGH for action security_group_rules [ 1058.464228] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 with Priority: HIGH for action security_group_rules [ 1058.464228] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGH for action security_group_rules [ 1058.464228] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGH for action security_group_rules [ 1058.464228] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29f22186-8565-4d84-ad72-633756f6f315 with Priority: HIGH for action security_group_rules [ 1058.464228] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad with Priority: HIGH for action security_group_rules [ 1058.464228] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.464228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.464228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.464612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.464612] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.465357] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.465420] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.465699] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e9a520d-8984-4d4d-934b-f46dbdac5f4d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.465699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e9a520d-8984-4d4d-934b-f46dbdac5f4d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.465861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e9a520d-8984-4d4d-934b-f46dbdac5f4d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.465936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e9a520d-8984-4d4d-934b-f46dbdac5f4d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.466265] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e9a520d-8984-4d4d-934b-f46dbdac5f4d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.467031] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.467031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.467186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.467477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.467477] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.469330] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b07f4606-a04e-468f-8194-7420bcbd987d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.469450] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.470362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.470362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.470362] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b07f4606-a04e-468f-8194-7420bcbd987d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.474958] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44ad09c8-ee6b-4496-8939-cd6fba160843 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.475342] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.475342] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.475468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.475546] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44ad09c8-ee6b-4496-8939-cd6fba160843',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.476379] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.476379] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.476520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.476675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.476974] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.478770] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9efb249-50ca-405f-918d-507bd86040c4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.478770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.478770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.478770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.478770] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9efb249-50ca-405f-918d-507bd86040c4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.478770] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.478770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.479138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.479138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.479138] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('687f9a90-8cf8-4c0f-bfe9-b1800ef9665c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.479766] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.479848] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.479918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.480076] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.480146] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bf5a5e9-3448-461d-8616-ceb9cef4d902',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.481277] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.481277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.481277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.481481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.481481] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1e9f6d0-9fe0-49a8-a7c4-58871051f77d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.484993] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85b46990-bd7b-4abe-881c-9016519cf955 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.484993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.484993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.484993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.484993] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85b46990-bd7b-4abe-881c-9016519cf955',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.484993] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.485351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.485351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.485351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.485351] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.486275] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad9ff44a-eecd-47a3-a497-f84ebc9294a5 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.487155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.487155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.487155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.487155] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad9ff44a-eecd-47a3-a497-f84ebc9294a5',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.487466] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.487637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.487637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.487935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.487935] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce19aa8e-b26d-4484-8765-4894bdbb95a0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.488533] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14808516-a2e0-455d-83e1-fa5b5fe0e828 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.488704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.488704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.488849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.488894] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14808516-a2e0-455d-83e1-fa5b5fe0e828',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.489897] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22827242-8721-47c3-af39-c8697770577f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.489897] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.490105] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.490105] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.490177] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22827242-8721-47c3-af39-c8697770577f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.491034] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.491152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.491203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.491345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.491416] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.492078] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5a72f78-b26f-4670-a8f0-eea902ebea26 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.492181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.492236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.492500] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.492759] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5a72f78-b26f-4670-a8f0-eea902ebea26',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.493360] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.493485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.493556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.493730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.493867] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.494596] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.494776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.494776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.494922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.494922] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be29eb73-d99e-4af1-ad2e-c5ce871f7807',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.495582] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29f22186-8565-4d84-ad72-633756f6f315 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.495958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.495958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.496183] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.496982] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29f22186-8565-4d84-ad72-633756f6f315',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.496982] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.497260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.497260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.497260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.497432] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.500829] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.767158] env[65102]: INFO networking_nsxv3.common.synchronization [req-c2afa4f7-199a-40e6-b50f-0f56d861c329 req-d3f4c803-7d0e-49c9-a87a-229ce9008816 tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_members [ 1058.767158] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_members [ 1058.767158] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.769667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.769875] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.770266] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.770569] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.770812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.770987] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.771400] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.771641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.771848] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.009477] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-be29eb73-d99e-4af1-ad2e-c5ce871f7807 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.013087] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.013087] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.013087] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.013087] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.013087] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.013087] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.013087] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.013087] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.013087] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.013087] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be29eb73-d99e-4af1-ad2e-c5ce871f7807',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.013087] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.015997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.015997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.015997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.015997] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.015997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.015997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.015997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.015997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.015997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.015997] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.024047] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.024680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.026031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.026031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.026031] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.026031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.026283] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.026394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.026541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.026720] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.028182] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.028958] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.029222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.029310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.029587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.029844] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.030044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.030200] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.030435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.030596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.030764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.031033] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.032486] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e9a520d-8984-4d4d-934b-f46dbdac5f4d with status ACTIVE [ 1059.032486] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.032673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.032793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.033062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.033232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.033514] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.033771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.033888] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.034129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.034607] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.034607] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.034738] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.034847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.036873] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.036873] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.036873] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e9a520d-8984-4d4d-934b-f46dbdac5f4d is going to be updated. [ 1059.037997] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.038950] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.050036] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.063997] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.069795] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.072314] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be29eb73-d99e-4af1-ad2e-c5ce871f7807',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.086049] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.086314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.086314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.086495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.086590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.086728] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1059.149982] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.149982] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.149982] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.150585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.152500] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.152653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.154689] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.154808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.158662] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.158866] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.158996] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.159280] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.159758] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.159957] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.160109] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.160370] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.160524] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.160771] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.160890] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.161024] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.161129] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.161249] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.161356] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.161496] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.163446] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.163595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.165840] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.165840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.171113] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.171476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.172352] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.172484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.173391] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.173540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.174848] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.175040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.181139] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.181363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.185034] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.185034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.189070] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.189070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.189070] env[65102]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.189070] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.189070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.189070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.189070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.189070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.189070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e9a520d-8984-4d4d-934b-f46dbdac5f4d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.189834] env[65102]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.190137] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.190263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.202802] env[65102]: WARNING urllib3.connectionpool [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.202802] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.202802] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1059.203110] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.203110] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.203523] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-6091d1cb-29b9-4a22-8827-990e8ea7d318 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.203741] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-6091d1cb-29b9-4a22-8827-990e8ea7d318" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.203881] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-6091d1cb-29b9-4a22-8827-990e8ea7d318" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.204303] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-6091d1cb-29b9-4a22-8827-990e8ea7d318" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.204454] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6091d1cb-29b9-4a22-8827-990e8ea7d318',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.206236] env[65102]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.206994] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.207106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.208415] env[65102]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.209033] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.209347] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.210700] env[65102]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.211290] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.211464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.214309] env[65102]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1059.214981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.215190] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5a72f78-b26f-4670-a8f0-eea902ebea26 is going to be deleted. [ 1059.216343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.216581] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.243793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.243980] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1e9f6d0-9fe0-49a8-a7c4-58871051f77d is going to be deleted. [ 1059.244981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.245254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.247440] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.247637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.247637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.247863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.248028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.261371] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1059.274036] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.274248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.301972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.301972] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9efb249-50ca-405f-918d-507bd86040c4 is going to be deleted. [ 1059.302943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.303231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.370878] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.371223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.376091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.376344] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85b46990-bd7b-4abe-881c-9016519cf955 is going to be deleted. [ 1059.377893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.378225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.380708] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.380924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.437385] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.437560] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 687f9a90-8cf8-4c0f-bfe9-b1800ef9665c is going to be deleted. [ 1059.438719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.439079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.467369] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 1059.467571] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f deletion is rescheduled due to dependency. [ 1059.467627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.467871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.468108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.468298] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.468416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.468481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.468643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.468806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.468873] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.470533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.470673] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44ad09c8-ee6b-4496-8939-cd6fba160843 is going to be deleted. [ 1059.472090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.472090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.540358] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.540358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.555740] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.555740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.555740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.555981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.556248] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.556248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.556360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.556522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.556610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.556716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.556901] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.556985] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.557052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.557207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.557352] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.557456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.557531] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.557745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.557847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.557939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.558047] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.566979] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.567280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.567619] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0212d5d1-3785-49e1-b4e8-aaad4f538d18: rpc.has_security_group_logging(os_id): False [ 1059.590066] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.590293] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22827242-8721-47c3-af39-c8697770577f is going to be deleted. [ 1059.591703] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be29eb73-d99e-4af1-ad2e-c5ce871f7807: rpc.has_security_group_logging(os_id): False [ 1059.592575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.592805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.593630] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29d98990-b866-4c6c-b1d9-41effdf1076b: rpc.has_security_group_logging(os_id): False [ 1059.619248] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.619451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.634291] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.634521] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.654732] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.655029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.665418] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.665636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.685369] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.685444] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14808516-a2e0-455d-83e1-fa5b5fe0e828 is going to be deleted. [ 1059.687344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.687459] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.711345] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.711636] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.711778] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.712237] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.712411] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.712581] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 6091d1cb-29b9-4a22-8827-990e8ea7d318 not found, creating... [ 1059.712873] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.713110] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.713179] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.713445] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.713596] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.713974] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.714238] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.714411] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.714771] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.714960] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.715295] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 6091d1cb-29b9-4a22-8827-990e8ea7d318 is going to be created. [ 1059.754698] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.754951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.758353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.758565] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14 is going to be deleted. [ 1059.759586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.759805] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.761509] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.761688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.782556] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.783039] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.783039] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.783221] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.783458] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.783724] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-6091d1cb-29b9-4a22-8827-990e8ea7d318" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.852577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.852772] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7 is going to be deleted. [ 1059.853978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.854286] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.954174] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.954830] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.963560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.963560] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bf5a5e9-3448-461d-8616-ceb9cef4d902 is going to be deleted. [ 1059.964320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.964780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.975069] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.975069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.975069] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.062252] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59c26ae1-e2ae-453d-a285-e702cf89832f: rpc.has_security_group_logging(os_id): False [ 1060.079938] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.080154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.099898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.100067] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b07f4606-a04e-468f-8194-7420bcbd987d is going to be deleted. [ 1060.101193] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.101512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.140808] env[65102]: INFO networking_nsxv3.common.synchronization [req-039ff3e5-b311-445b-85a1-560b9ea3c0c6 req-c46cfd96-92ec-40a4-90bf-fcf77c850d4f tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1060.141669] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1060.141866] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.142018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.143934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.143934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.143934] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.143934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.143934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.143934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.143934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.143934] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.146749] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.146749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.160083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.160255] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce19aa8e-b26d-4484-8765-4894bdbb95a0 is going to be deleted. [ 1060.161948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.161999] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.257955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.258171] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad9ff44a-eecd-47a3-a497-f84ebc9294a5 is going to be deleted. [ 1060.259196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.259434] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.261021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.261171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.323963] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.324173] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.329167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.329294] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29f22186-8565-4d84-ad72-633756f6f315 is going to be deleted. [ 1060.330487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.330487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.374857] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.375150] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad is going to be deleted. [ 1060.376715] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.376915] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.377073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.377420] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.377619] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.377714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.377989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.378132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.378277] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b already deleted. [ 1060.378446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.378704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.378966] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.379123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.379314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1e9f6d0-9fe0-49a8-a7c4-58871051f77d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.380262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.380460] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.380567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.380767] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5a72f78-b26f-4670-a8f0-eea902ebea26" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.380970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.381217] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.381353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.381548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9efb249-50ca-405f-918d-507bd86040c4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.381762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.381995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.382127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.382308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85b46990-bd7b-4abe-881c-9016519cf955" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.382499] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.382696] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.382832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.383029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-687f9a90-8cf8-4c0f-bfe9-b1800ef9665c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.383251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.383471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.399717] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.399717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.432530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.432846] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.432977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.433038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.433237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.433316] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.433409] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 is going to be updated. [ 1060.434600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.436109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.480900] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.510648] env[65102]: INFO networking_nsxv3.common.synchronization [req-c2afa4f7-199a-40e6-b50f-0f56d861c329 req-c9baa032-9e6e-41a5-b14b-d0db447011cc service nova] Enqueued Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_rules [ 1060.510725] env[65102]: INFO networking_nsxv3.common.synchronization [req-c2afa4f7-199a-40e6-b50f-0f56d861c329 req-c9baa032-9e6e-41a5-b14b-d0db447011cc service nova] Enqueued Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_members [ 1060.510862] env[65102]: INFO networking_nsxv3.common.synchronization [req-c2afa4f7-199a-40e6-b50f-0f56d861c329 req-c9baa032-9e6e-41a5-b14b-d0db447011cc service nova] Enqueued Resource ID: 6091d1cb-29b9-4a22-8827-990e8ea7d318 with Priority: HIGHEST for action port [ 1060.511395] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_rules [ 1060.511529] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_members [ 1060.511627] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6091d1cb-29b9-4a22-8827-990e8ea7d318 with Priority: HIGHEST for action port [ 1060.512498] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.512598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.512814] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.513061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.513131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.513399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.513487] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.516995] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.516995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.516995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.516995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.516995] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.516995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.516995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.516995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.516995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.516995] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.516995] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-6091d1cb-29b9-4a22-8827-990e8ea7d318 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.516995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6091d1cb-29b9-4a22-8827-990e8ea7d318" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.516995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6091d1cb-29b9-4a22-8827-990e8ea7d318" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.517996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6091d1cb-29b9-4a22-8827-990e8ea7d318" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.517996] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6091d1cb-29b9-4a22-8827-990e8ea7d318',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.524102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.524429] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.524558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.524624] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.524827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.524914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.525019] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b is going to be updated. [ 1060.527043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.527251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.527343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.527461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44ad09c8-ee6b-4496-8939-cd6fba160843" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.527620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.527782] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.527861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.527976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22827242-8721-47c3-af39-c8697770577f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.529144] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.529256] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.529749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.529749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.529749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.535189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29f22186-8565-4d84-ad72-633756f6f315" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.536394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.536394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.536503] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.536653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14808516-a2e0-455d-83e1-fa5b5fe0e828" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.536797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.536955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.537044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.537157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8b8f9b4-10b6-42cc-a8a8-9c96209d4c14" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.537888] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.538223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.538410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.538896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9d01a0c-bf0a-40e9-b26e-cf012fac6cb7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.539485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.539650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.624662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.624985] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.625131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.625200] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.625417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.625505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.625743] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.625866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.625902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.626075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.626154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.626355] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.626438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.626501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.626690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.626770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.626856] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1060.628296] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.628630] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.628776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.628967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce19aa8e-b26d-4484-8765-4894bdbb95a0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.629166] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.629986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.632133] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.632294] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.633847] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.634426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.648064] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.676181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.676480] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.676671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.676758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.676983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.677091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.677200] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be updated. [ 1060.678532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.678779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.679184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.679184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bf5a5e9-3448-461d-8616-ceb9cef4d902" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.679323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.679509] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.679630] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.679781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b07f4606-a04e-468f-8194-7420bcbd987d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.680018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.680271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.680409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.681477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.681830] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.681975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.682138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad9ff44a-eecd-47a3-a497-f84ebc9294a5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.682840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.683051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.683187] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.683335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0492e5-66d3-4882-a2c0-eb93bcb5a8ad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.754998] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 in Status: IN_PROGRESS for 2s [ 1060.803180] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.803485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.803485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.803744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.803898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.842475] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.842574] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.842609] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.842810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.842963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.848362] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: IN_PROGRESS for 2s [ 1060.984102] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.984267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.984340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.984567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.984653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.984752] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 1061.018635] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.019796] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.020899] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.023574] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6091d1cb-29b9-4a22-8827-990e8ea7d318 with status ACTIVE [ 1061.023971] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.024081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.024132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.024338] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.024430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.024615] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.024731] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.024806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.024955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.025060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.025253] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.025348] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.025409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.025567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.025616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.025704] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6091d1cb-29b9-4a22-8827-990e8ea7d318 is going to be updated. [ 1061.045380] env[65102]: INFO networking_nsxv3.common.synchronization [None req-26b2faf9-7eb5-46d0-a138-f4e1fce9e26b tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1061.046316] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1061.047348] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.047348] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.051962] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.053272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.053272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.053272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.053272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.065067] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1061.068646] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.068785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.068859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.069082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.069220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.069376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6091d1cb-29b9-4a22-8827-990e8ea7d318" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.081557] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: IN_PROGRESS for 2s [ 1061.113038] env[65102]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1061.113620] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.113832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.113912] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.114148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.114292] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.132929] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 1061.150785] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.278026] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1061.278274] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.278454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.278684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.278885] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.279040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.279101] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.279232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.279307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.279389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.279477] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.521786] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.653653] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.653863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.653939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.654185] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.654282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.654387] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1061.687741] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.687910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.688047] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.688216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.688378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.707655] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1061.782527] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.782527] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.784638] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.785202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.785457] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.785616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.785711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.785950] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.786258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.786320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.786502] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.786707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.786795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.786974] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.787229] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.787463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.787653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.787749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.787862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.787996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.788129] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.025580] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.025923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.025923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.026033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.026124] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.026225] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b is going to be created. [ 1062.055621] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.056085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.056085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.056174] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.056691] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.077731] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b in Status: UNINITIALIZED for 2s [ 1062.289935] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8746f52-1411-469d-8df9-8b15536649f6: rpc.has_security_group_logging(os_id): False [ 1062.311429] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.312219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.312375] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.312617] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.347152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.347413] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.347532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.347616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.347826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.347934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.348127] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.348217] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.348286] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.352148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.352416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.352731] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.352855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.352953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.353160] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.353244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.353388] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1062.446252] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.446473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.446473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.446719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.446880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.462417] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1062.778926] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 in Status: SUCCESS [ 1062.779186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.865560] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: SUCCESS [ 1062.865560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.083316] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1063.084594] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.100612] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 1063.100740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.145246] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 1063.145409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.145696] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.145989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.146189] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.146340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.146419] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.146594] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.146811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.146811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.146932] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.232018] env[65102]: INFO networking_nsxv3.common.synchronization [req-bb410d19-0589-4967-b253-01b5a81f8a2e req-ae41108d-90ad-4f2e-9114-47669230b836 tempest-ImagesNegativeTestJSON-1955032755 tempest-ImagesNegativeTestJSON-1955032755-project-member] Enqueued Resource ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 with Priority: HIGHEST for action security_group_members [ 1063.236572] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 with Priority: HIGHEST for action security_group_members [ 1063.237114] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.238248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.238248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.238248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.238475] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.238475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.238475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.238706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.238706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.239017] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da64d8cd-1e23-4ba6-bed1-a5337d6e1da4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.632462] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-933 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.632666] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-933" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.632789] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-933" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.633136] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-933" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.633407] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.633567] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.633685] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.633903] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.634058] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.634264] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1063.634380] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.634527] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.634685] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.634753] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1063.634914] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.635073] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.649581] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.649748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.649806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.649990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.650161] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.650262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.650326] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.650474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.650563] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.650688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.650877] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.651042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.651042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.651278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.651366] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.651425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.651468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.651594] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.651670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.651750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.651839] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.654137] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.654173] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1063.654310] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.654493] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-933" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.654793] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-32156605-37d7-4888-9a96-3ac243961051 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.655247] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-32156605-37d7-4888-9a96-3ac243961051" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.655247] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-32156605-37d7-4888-9a96-3ac243961051" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.655369] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-32156605-37d7-4888-9a96-3ac243961051" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.655505] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32156605-37d7-4888-9a96-3ac243961051',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.720081] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1063.720358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.720578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.721058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.721113] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.721263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.721353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.721563] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.721679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.721802] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.740989] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.741218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.741218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.741430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.742278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.742492] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.742601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.742668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.742837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.742919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.743013] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 already deleted. [ 1063.745096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.877047] env[65102]: INFO networking_nsxv3.common.synchronization [req-7311433b-1af7-4726-a807-26ecda311f12 req-479114fe-f88f-40f0-9bb1-e2f565844dff tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGHEST for action security_group_members [ 1063.877342] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGHEST for action security_group_members [ 1063.877681] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-be29eb73-d99e-4af1-ad2e-c5ce871f7807 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.877871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.877871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.878061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.878233] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.878315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.878364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.878515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.878601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.878694] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be29eb73-d99e-4af1-ad2e-c5ce871f7807',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.095790] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b in Status: SUCCESS [ 1064.096241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.096376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.096737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.096940] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.097078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.097148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.097324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.097552] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.097667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.097788] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.154099] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 99c8f96e-2cdb-49cd-8847-bf7698ff539f: rpc.has_security_group_logging(os_id): False [ 1064.157191] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.157415] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.157573] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.157851] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.158023] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.158190] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 32156605-37d7-4888-9a96-3ac243961051 not found, creating... [ 1064.158468] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.158634] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.158751] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.158995] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.159151] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.159457] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.159621] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.159758] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.160026] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.160151] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.160309] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 32156605-37d7-4888-9a96-3ac243961051 is going to be created. [ 1064.175495] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.175690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.175690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.175935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.176033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.176261] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.176377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.176377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.176576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.176643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.176841] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.176943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.177016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.177176] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.177278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.177519] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.177639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.177717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.178105] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.178105] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.178105] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 1064.185678] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.185958] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.186094] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.186364] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.186790] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.187061] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-32156605-37d7-4888-9a96-3ac243961051" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.224752] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.224968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.225088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.225392] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.225491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.225735] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.225850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.225937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.226154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.226237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.227132] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1064.276769] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.276769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.276769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.276769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.276769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.310027] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.310027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.310027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.310027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.310027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.312113] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 1064.329647] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1064.380563] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.380769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.380842] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.381114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.381257] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.381490] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.381599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.381668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.381843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.381927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.382035] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 is going to be updated. [ 1064.436200] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.436467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.436587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.436955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.437275] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.452085] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 in Status: IN_PROGRESS for 2s [ 1064.478477] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1064.478844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.600515] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.600677] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.600749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.600949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.601135] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.601238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.601305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.601456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.601546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.601633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.601780] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.601872] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.601941] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.602085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.602219] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.602919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.602919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.602919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.602919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.602919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.602919] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.904585] env[65102]: INFO networking_nsxv3.common.synchronization [req-bb410d19-0589-4967-b253-01b5a81f8a2e req-720c1885-36b9-4f73-b0b1-8e04d0a9f799 service nova] Enqueued Resource ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 with Priority: HIGHEST for action security_group_rules [ 1064.904768] env[65102]: INFO networking_nsxv3.common.synchronization [req-bb410d19-0589-4967-b253-01b5a81f8a2e req-720c1885-36b9-4f73-b0b1-8e04d0a9f799 service nova] Enqueued Resource ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 with Priority: HIGHEST for action security_group_members [ 1064.904903] env[65102]: INFO networking_nsxv3.common.synchronization [req-bb410d19-0589-4967-b253-01b5a81f8a2e req-720c1885-36b9-4f73-b0b1-8e04d0a9f799 service nova] Enqueued Resource ID: 32156605-37d7-4888-9a96-3ac243961051 with Priority: HIGHEST for action port [ 1064.905439] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 with Priority: HIGHEST for action security_group_rules [ 1064.905577] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 with Priority: HIGHEST for action security_group_members [ 1064.905675] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32156605-37d7-4888-9a96-3ac243961051 with Priority: HIGHEST for action port [ 1064.905948] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.906382] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.906533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.906800] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.906887] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da64d8cd-1e23-4ba6-bed1-a5337d6e1da4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.908020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.908967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.908967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.908967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.908967] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.909152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.909152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.909251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.911499] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.911499] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da64d8cd-1e23-4ba6-bed1-a5337d6e1da4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.911499] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-32156605-37d7-4888-9a96-3ac243961051 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.911499] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32156605-37d7-4888-9a96-3ac243961051" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.911499] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32156605-37d7-4888-9a96-3ac243961051" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.911499] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32156605-37d7-4888-9a96-3ac243961051" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.911499] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32156605-37d7-4888-9a96-3ac243961051',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.105414] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a03dedcf-91ec-46f5-b008-cad3f9c1d50b: rpc.has_security_group_logging(os_id): False [ 1065.125025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.125025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.125025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.125025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.125025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.125025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.125025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.125025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.125025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.125377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.125377] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.125377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.125469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.125552] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.125617] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.127045] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.127045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.127045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.127045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.127045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.127045] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b is going to be created. [ 1065.184575] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.184733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.184817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.185060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.185258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.197877] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b in Status: IN_PROGRESS for 2s [ 1065.412906] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.413164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.413305] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da64d8cd-1e23-4ba6-bed1-a5337d6e1da4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.414540] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32156605-37d7-4888-9a96-3ac243961051 with status ACTIVE [ 1065.414664] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.414753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.414812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.414992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.415088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.415277] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.415363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.415416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.415574] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.415644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.415868] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.415968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.415968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.416128] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.416204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.416327] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32156605-37d7-4888-9a96-3ac243961051 is going to be updated. [ 1065.443648] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.443861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.443968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.444243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.444597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.444789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32156605-37d7-4888-9a96-3ac243961051" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.919188] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da64d8cd-1e23-4ba6-bed1-a5337d6e1da4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.191386] env[65102]: INFO networking_nsxv3.common.synchronization [None req-a85b1c6a-1511-4d3d-bdfd-07a083b93585 None None] Enqueued Resource ID: 5c1abe44-946e-4c80-9fde-36b7bda0a106 with Priority: HIGHEST for action port [ 1066.191386] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c1abe44-946e-4c80-9fde-36b7bda0a106 with Priority: HIGHEST for action port [ 1066.194474] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c1abe44-946e-4c80-9fde-36b7bda0a106 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.194474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c1abe44-946e-4c80-9fde-36b7bda0a106" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.194474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c1abe44-946e-4c80-9fde-36b7bda0a106" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.194474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c1abe44-946e-4c80-9fde-36b7bda0a106" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.194474] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c1abe44-946e-4c80-9fde-36b7bda0a106',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.340639] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1066.341875] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f deletion is rescheduled due to dependency. [ 1066.342161] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.343458] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 1066.343771] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.424810] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.424810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.424810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.424810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.424810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.424810] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 is going to be created. [ 1066.449657] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.451993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.451993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.451993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.451993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.464053] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 in Status: UNINITIALIZED for 2s [ 1066.464053] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 in Status: SUCCESS [ 1066.464053] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 deletion is rescheduled due to dependency. [ 1066.464053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.695410] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c1abe44-946e-4c80-9fde-36b7bda0a106 [ 1066.695664] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.695801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.695873] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.696104] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.696192] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.696290] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c1abe44-946e-4c80-9fde-36b7bda0a106 already deleted. [ 1066.696517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c1abe44-946e-4c80-9fde-36b7bda0a106" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.216428] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b in Status: SUCCESS [ 1067.216769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.337988] env[65102]: INFO networking_nsxv3.common.synchronization [None req-1c8f1ad5-b823-4a82-a9a8-178dd7d42f64 tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_rules [ 1068.338635] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_rules [ 1068.338993] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4501856-910f-4bf4-9fd2-4d3675738a94 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.339139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.339206] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.339549] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.339657] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.442643] env[65102]: INFO networking_nsxv3.common.synchronization [None req-de1e28d4-53c0-4025-8246-1dc0b0f94b5f tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_rules [ 1068.443068] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_rules [ 1068.443439] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4501856-910f-4bf4-9fd2-4d3675738a94 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.443740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.466086] env[65102]: INFO networking_nsxv3.common.synchronization [None req-65685838-f979-48bd-8a6b-0169268ce1ce None None] Enqueued Resource ID: 48bedb42-ee1a-4f05-92ad-f4d537f15046 with Priority: HIGHEST for action port [ 1068.466740] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48bedb42-ee1a-4f05-92ad-f4d537f15046 with Priority: HIGHEST for action port [ 1068.467534] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-48bedb42-ee1a-4f05-92ad-f4d537f15046 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.467661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48bedb42-ee1a-4f05-92ad-f4d537f15046" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.467732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48bedb42-ee1a-4f05-92ad-f4d537f15046" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.467991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48bedb42-ee1a-4f05-92ad-f4d537f15046" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.468092] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48bedb42-ee1a-4f05-92ad-f4d537f15046',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.477222] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 in Status: SUCCESS [ 1068.477222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.477595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.477828] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.478072] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.478196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.478262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.478426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.478892] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.478892] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.478892] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da64d8cd-1e23-4ba6-bed1-a5337d6e1da4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.864100] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.864100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.864100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.864100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.864100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.864100] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4501856-910f-4bf4-9fd2-4d3675738a94 already deleted. [ 1068.864100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.864100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.864468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.864468] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.970439] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48bedb42-ee1a-4f05-92ad-f4d537f15046 [ 1068.970706] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.970841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.970912] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.971146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.971258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.971361] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48bedb42-ee1a-4f05-92ad-f4d537f15046 already deleted. [ 1068.971445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48bedb42-ee1a-4f05-92ad-f4d537f15046" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.982150] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.983309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.983411] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.983709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.984044] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.984044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.984044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.984186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.984186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.985252] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.985252] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.987478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.987478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.987478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.987661] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.987661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.987738] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.989022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.989022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.989022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.989022] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da64d8cd-1e23-4ba6-bed1-a5337d6e1da4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.017269] env[65102]: INFO networking_nsxv3.common.synchronization [req-5287b9cf-1367-45e2-b1d9-75f2b05ebee9 req-033aef30-1fb0-4427-b2a5-d8cd8c132d32 tempest-ServersTestJSON-191426844 tempest-ServersTestJSON-191426844-project-member] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1069.017520] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1069.017692] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.017826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.017893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.020047] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.020047] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.020047] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.020047] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.022279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.022382] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.022486] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.391315] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.391727] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.391727] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.393038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.393038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.393038] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4501856-910f-4bf4-9fd2-4d3675738a94 already deleted. [ 1069.393038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.491472] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da64d8cd-1e23-4ba6-bed1-a5337d6e1da4: rpc.has_security_group_logging(os_id): False [ 1069.512125] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.512256] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.512291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.513164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.513164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.513164] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.513164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.513164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.513164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.513164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.513484] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.513484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.513549] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.513716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.513768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.513918] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.514623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.514623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.514781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.514828] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.514948] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 is going to be created. [ 1069.524843] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.587503] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.587732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.587773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.588068] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.588223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.604585] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 in Status: IN_PROGRESS for 2s [ 1070.027646] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.533299] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.533666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.533666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.533761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.533761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.533863] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1070.565209] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.565349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.565422] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.565640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.565786] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.575398] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1071.148442] env[65102]: INFO networking_nsxv3.common.synchronization [None req-0decdd7e-33ed-4942-95bd-ad458297ecdb tempest-ServerDiskConfigTestJSON-1771527805 tempest-ServerDiskConfigTestJSON-1771527805-project-member] Enqueued Resource ID: c510a0ff-2eae-4264-a9e7-7cec4edd5a99 with Priority: HIGHEST for action security_group_rules [ 1071.149263] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c510a0ff-2eae-4264-a9e7-7cec4edd5a99 with Priority: HIGHEST for action security_group_rules [ 1071.149732] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c510a0ff-2eae-4264-a9e7-7cec4edd5a99 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.149831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c510a0ff-2eae-4264-a9e7-7cec4edd5a99" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.149831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c510a0ff-2eae-4264-a9e7-7cec4edd5a99" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.150196] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c510a0ff-2eae-4264-a9e7-7cec4edd5a99" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.150304] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c510a0ff-2eae-4264-a9e7-7cec4edd5a99',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.253360] env[65102]: INFO networking_nsxv3.common.synchronization [None req-6f2df644-5b93-4f89-a44f-1c737332441a tempest-ServerDiskConfigTestJSON-1771527805 tempest-ServerDiskConfigTestJSON-1771527805-project-member] Enqueued Resource ID: c510a0ff-2eae-4264-a9e7-7cec4edd5a99 with Priority: HIGHEST for action security_group_rules [ 1071.254240] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c510a0ff-2eae-4264-a9e7-7cec4edd5a99 with Priority: HIGHEST for action security_group_rules [ 1071.254688] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c510a0ff-2eae-4264-a9e7-7cec4edd5a99 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.254865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c510a0ff-2eae-4264-a9e7-7cec4edd5a99" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.617453] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 in Status: SUCCESS [ 1071.618749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.678554] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.678732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.678810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.679044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.679172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.679271] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c510a0ff-2eae-4264-a9e7-7cec4edd5a99 already deleted. [ 1071.679374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c510a0ff-2eae-4264-a9e7-7cec4edd5a99" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.679554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c510a0ff-2eae-4264-a9e7-7cec4edd5a99" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.679721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c510a0ff-2eae-4264-a9e7-7cec4edd5a99" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.679807] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c510a0ff-2eae-4264-a9e7-7cec4edd5a99',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.200941] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.200941] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.201142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.201240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.201315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.201526] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c510a0ff-2eae-4264-a9e7-7cec4edd5a99 already deleted. [ 1072.201625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c510a0ff-2eae-4264-a9e7-7cec4edd5a99" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.586035] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1072.586035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.163297] env[65102]: INFO networking_nsxv3.common.synchronization [req-e64c7e57-2b7d-4b29-9529-9ef28cdf8dd3 req-9230848e-6c59-4147-8ca5-2aeade7b4901 tempest-ServerRescueTestJSON-675599107 tempest-ServerRescueTestJSON-675599107-project-member] Enqueued Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_members [ 1073.164438] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_members [ 1073.164887] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.165056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.165167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.165546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.165749] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.165907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.166090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.166209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.166306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.166415] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.505999] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-378 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.506271] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-378" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.506714] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-378" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.506785] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-378" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.507069] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.507224] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.507825] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.507825] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.507825] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.508423] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.508644] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.508804] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.508972] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.509141] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.509288] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.509436] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.530492] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.530713] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1073.530790] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.530976] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-378" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.531317] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-5343cf6f-59a3-4f9c-a534-449b9816168a taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.531495] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-5343cf6f-59a3-4f9c-a534-449b9816168a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.531614] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-5343cf6f-59a3-4f9c-a534-449b9816168a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.531936] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-5343cf6f-59a3-4f9c-a534-449b9816168a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.532091] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5343cf6f-59a3-4f9c-a534-449b9816168a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.668651] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.672287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.672287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.672287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.672287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.672287] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.672287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.672287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.672287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.672287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.672287] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d17fda10-7148-4558-b429-6c6b75b5f20d already deleted. [ 1073.672287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.034685] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.035019] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.035197] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.035563] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.035779] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.035976] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 5343cf6f-59a3-4f9c-a534-449b9816168a not found, creating... [ 1074.036317] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.036486] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.036662] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.036910] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.037068] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.037377] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.037541] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.037658] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.037864] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.037998] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.038161] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 5343cf6f-59a3-4f9c-a534-449b9816168a is going to be created. [ 1074.066739] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.067058] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.067220] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.067532] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.067849] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.068113] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-5343cf6f-59a3-4f9c-a534-449b9816168a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.749414] env[65102]: INFO networking_nsxv3.common.synchronization [req-7351f651-3a4d-44d4-9de6-daba2134d629 req-fd798ff2-9a03-48c5-8328-6967339d4827 tempest-ServerDiskConfigTestJSON-1771527805 tempest-ServerDiskConfigTestJSON-1771527805-project-member] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1074.749597] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1074.750373] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.750373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.750373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.750373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.750373] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.750616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.750616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.750674] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.750716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.750821] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.814022] env[65102]: INFO networking_nsxv3.common.synchronization [req-e64c7e57-2b7d-4b29-9529-9ef28cdf8dd3 req-7c680c46-0eed-4016-a560-3c86e9c5706e service nova] Enqueued Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_rules [ 1074.814206] env[65102]: INFO networking_nsxv3.common.synchronization [req-e64c7e57-2b7d-4b29-9529-9ef28cdf8dd3 req-7c680c46-0eed-4016-a560-3c86e9c5706e service nova] Enqueued Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_members [ 1074.814350] env[65102]: INFO networking_nsxv3.common.synchronization [req-e64c7e57-2b7d-4b29-9529-9ef28cdf8dd3 req-7c680c46-0eed-4016-a560-3c86e9c5706e service nova] Enqueued Resource ID: 5343cf6f-59a3-4f9c-a534-449b9816168a with Priority: HIGHEST for action port [ 1074.815108] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_rules [ 1074.815279] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_members [ 1074.815353] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5343cf6f-59a3-4f9c-a534-449b9816168a with Priority: HIGHEST for action port [ 1074.815865] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.815987] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.816069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.816355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.816437] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.817309] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.817424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.817487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.817710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.818078] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.818178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.818240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.818385] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.818482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.818572] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.819309] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-5343cf6f-59a3-4f9c-a534-449b9816168a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.819413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5343cf6f-59a3-4f9c-a534-449b9816168a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.819478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5343cf6f-59a3-4f9c-a534-449b9816168a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.819609] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5343cf6f-59a3-4f9c-a534-449b9816168a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.819678] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5343cf6f-59a3-4f9c-a534-449b9816168a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.253198] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.253470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.253470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.253633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.274372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.274740] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.274929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.275069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.275359] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.275496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.275649] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 1075.304361] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.304516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.304590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.304821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.305162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.314918] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 1075.321409] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.321530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.321713] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.322617] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5343cf6f-59a3-4f9c-a534-449b9816168a with status ACTIVE [ 1075.322836] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.322952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.323027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.323245] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.323344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.323513] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.323610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.324733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.324733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.324733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.324733] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.324733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.324733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.324733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.324733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.324733] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5343cf6f-59a3-4f9c-a534-449b9816168a is going to be updated. [ 1075.346038] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.346651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.346651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.346651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.346651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.346773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5343cf6f-59a3-4f9c-a534-449b9816168a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.826534] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.859859] env[65102]: INFO networking_nsxv3.common.synchronization [req-0b9c00e2-6161-4508-a088-30aa1f616513 req-c25c7f95-e38e-47be-b28f-693c3756b7f7 tempest-ImagesNegativeTestJSON-1955032755 tempest-ImagesNegativeTestJSON-1955032755-project-member] Enqueued Resource ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 with Priority: HIGHEST for action security_group_members [ 1075.860437] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 with Priority: HIGHEST for action security_group_members [ 1075.860714] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.860843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.860947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.861684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.861684] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.861684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.861684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.861900] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.861900] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.861900] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da64d8cd-1e23-4ba6-bed1-a5337d6e1da4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.329601] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.329825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.329825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.330060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.330156] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.330257] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d17fda10-7148-4558-b429-6c6b75b5f20d is going to be created. [ 1076.356499] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.356670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.356710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.356904] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.357132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.363991] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.364198] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.364271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.364414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.364504] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.364777] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.364882] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.364981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.365233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.365296] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.365390] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 is going to be updated. [ 1076.371664] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d17fda10-7148-4558-b429-6c6b75b5f20d in Status: UNINITIALIZED for 2s [ 1076.393844] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.394014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.394109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.394345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.394488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.402983] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 in Status: IN_PROGRESS for 2s [ 1077.334559] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 1077.335045] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f deletion is rescheduled due to dependency. [ 1077.335045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.384138] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d17fda10-7148-4558-b429-6c6b75b5f20d in Status: SUCCESS [ 1078.384489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.384579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.384789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.384997] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.385130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.385194] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.385362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.385449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.385537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.385642] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.412881] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 in Status: SUCCESS [ 1078.412881] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da64d8cd-1e23-4ba6-bed1-a5337d6e1da4 deletion is rescheduled due to dependency. [ 1078.412881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da64d8cd-1e23-4ba6-bed1-a5337d6e1da4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.889221] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.889221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.889221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.889221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.889221] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.889635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.889635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.889635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.889635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.889763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.889834] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.889886] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.889919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.890091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.890231] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.890319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.890378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.890513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.890589] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.890671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.890757] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.394127] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d17fda10-7148-4558-b429-6c6b75b5f20d: rpc.has_security_group_logging(os_id): False [ 1079.412224] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.412433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.412433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.412955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.412955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.412955] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.412955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.413190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.413190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.413244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.413423] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.413502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.413563] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.413701] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.413778] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.413977] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.414146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.414187] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.414354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.414401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.414473] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d17fda10-7148-4558-b429-6c6b75b5f20d is going to be created. [ 1079.485491] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.485930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.486042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.486302] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.486494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.498684] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d17fda10-7148-4558-b429-6c6b75b5f20d in Status: IN_PROGRESS for 2s [ 1079.818580] env[65102]: INFO networking_nsxv3.common.synchronization [req-c16b869d-6e87-4e39-b86d-7dc52647ee44 req-01669f96-bd6b-41fd-8fa2-5bdd9cc7e927 tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_members [ 1079.818580] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_members [ 1079.818580] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4501856-910f-4bf4-9fd2-4d3675738a94 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.818580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.818580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.818760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.819677] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.819791] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.819855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.820034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.820117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.820212] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.325577] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.325577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.325577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.325577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.325577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.325577] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.325577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.325577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.325577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.325577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.325577] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4501856-910f-4bf4-9fd2-4d3675738a94 already deleted. [ 1080.325577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.635053] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.635053] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.635053] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.635053] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.635637] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.635637] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.635637] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.635783] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.635841] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.636113] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1080.636229] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.636335] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.636441] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.636546] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1080.636648] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.636777] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.655604] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.655783] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1080.655887] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.656268] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.656622] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-47322e57-eaa6-4bb8-98ec-3098749bd52c taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.656807] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-47322e57-eaa6-4bb8-98ec-3098749bd52c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.656946] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-47322e57-eaa6-4bb8-98ec-3098749bd52c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.657320] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-47322e57-eaa6-4bb8-98ec-3098749bd52c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.657463] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47322e57-eaa6-4bb8-98ec-3098749bd52c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.160395] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.160591] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.160668] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.160966] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.161148] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.161301] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 47322e57-eaa6-4bb8-98ec-3098749bd52c not found, creating... [ 1081.161716] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.162472] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.162472] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.162472] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.162624] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.162898] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.163018] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.163168] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.163385] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.163522] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.163683] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 47322e57-eaa6-4bb8-98ec-3098749bd52c is going to be created. [ 1081.189440] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.189905] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.190165] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.190924] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.190924] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.191400] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-47322e57-eaa6-4bb8-98ec-3098749bd52c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.509976] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d17fda10-7148-4558-b429-6c6b75b5f20d in Status: SUCCESS [ 1081.510240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.883422] env[65102]: INFO networking_nsxv3.common.synchronization [req-c16b869d-6e87-4e39-b86d-7dc52647ee44 req-c302d47d-b090-4f66-beb7-78c3ee02a69b service nova] Enqueued Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_rules [ 1081.883666] env[65102]: INFO networking_nsxv3.common.synchronization [req-c16b869d-6e87-4e39-b86d-7dc52647ee44 req-c302d47d-b090-4f66-beb7-78c3ee02a69b service nova] Enqueued Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_members [ 1081.883725] env[65102]: INFO networking_nsxv3.common.synchronization [req-c16b869d-6e87-4e39-b86d-7dc52647ee44 req-c302d47d-b090-4f66-beb7-78c3ee02a69b service nova] Enqueued Resource ID: 47322e57-eaa6-4bb8-98ec-3098749bd52c with Priority: HIGHEST for action port [ 1081.884262] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_rules [ 1081.884401] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_members [ 1081.884498] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47322e57-eaa6-4bb8-98ec-3098749bd52c with Priority: HIGHEST for action port [ 1081.884797] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4501856-910f-4bf4-9fd2-4d3675738a94 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.884895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.884965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.885215] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.885299] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.886213] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4501856-910f-4bf4-9fd2-4d3675738a94 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.886333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.886399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.886575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.886749] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.886847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.886932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.887450] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.887450] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.887450] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.888764] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-47322e57-eaa6-4bb8-98ec-3098749bd52c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.888840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47322e57-eaa6-4bb8-98ec-3098749bd52c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.888968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47322e57-eaa6-4bb8-98ec-3098749bd52c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.890488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47322e57-eaa6-4bb8-98ec-3098749bd52c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.890594] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47322e57-eaa6-4bb8-98ec-3098749bd52c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.276111] env[65102]: INFO networking_nsxv3.common.synchronization [req-914b69b6-393e-413b-98a2-795981939c54 req-9fd89683-ef52-4e1c-82a1-9e9da77c92c3 tempest-ServerDiskConfigTestJSON-1771527805 tempest-ServerDiskConfigTestJSON-1771527805-project-member] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1082.276649] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1082.276963] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.277116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.277186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.277414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.277579] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.277680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.277748] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.277909] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.278016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.278112] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.392939] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.394115] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4501856-910f-4bf4-9fd2-4d3675738a94 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.394862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.394862] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47322e57-eaa6-4bb8-98ec-3098749bd52c with status ACTIVE [ 1082.394862] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.394862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.394862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.395120] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.395120] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.395184] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.395774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.395774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.395774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.395774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.395774] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.395975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.395975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.396052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.396165] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.396206] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47322e57-eaa6-4bb8-98ec-3098749bd52c is going to be updated. [ 1082.418059] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.418240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.418436] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.418490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.418596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.418780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47322e57-eaa6-4bb8-98ec-3098749bd52c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.674967] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-312 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.675279] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.675412] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.675708] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.676042] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.676223] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.676343] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.676572] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.676722] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.677008] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.677137] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.677271] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.677384] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.677500] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.677608] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.677744] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.698891] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.699207] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1082.699525] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.699795] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.700213] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-38203ad5-ce82-479b-8bb4-774b4fb04634 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.700661] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-38203ad5-ce82-479b-8bb4-774b4fb04634" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.700868] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-38203ad5-ce82-479b-8bb4-774b4fb04634" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.701269] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-38203ad5-ce82-479b-8bb4-774b4fb04634" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.701458] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38203ad5-ce82-479b-8bb4-774b4fb04634',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.780548] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.780777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.780861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.781152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.781244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.781506] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.781726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.781726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.781977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.782064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.782122] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 1082.810654] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.810814] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.810873] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.811179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.811356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.821700] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 1082.899066] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.207048] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.207048] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.207048] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.207048] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.207048] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.207048] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 38203ad5-ce82-479b-8bb4-774b4fb04634 not found, creating... [ 1083.207048] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.207048] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.207048] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.207048] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.207048] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.207651] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.207651] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.207651] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.208194] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.210854] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.210854] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 38203ad5-ce82-479b-8bb4-774b4fb04634 is going to be created. [ 1083.231912] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.232152] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.232280] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.232546] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.232764] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.232998] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-38203ad5-ce82-479b-8bb4-774b4fb04634" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.401360] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.401541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.401618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.401839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.401942] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.402357] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4501856-910f-4bf4-9fd2-4d3675738a94 is going to be created. [ 1083.436353] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.436620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.436620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.436772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.436966] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.448508] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4501856-910f-4bf4-9fd2-4d3675738a94 in Status: UNINITIALIZED for 2s [ 1083.949044] env[65102]: INFO networking_nsxv3.common.synchronization [req-914b69b6-393e-413b-98a2-795981939c54 req-8d1c6932-8e71-45eb-87d8-6cb57b8b80ef service nova] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_rules [ 1083.950208] env[65102]: INFO networking_nsxv3.common.synchronization [req-914b69b6-393e-413b-98a2-795981939c54 req-8d1c6932-8e71-45eb-87d8-6cb57b8b80ef service nova] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1083.950208] env[65102]: INFO networking_nsxv3.common.synchronization [req-914b69b6-393e-413b-98a2-795981939c54 req-8d1c6932-8e71-45eb-87d8-6cb57b8b80ef service nova] Enqueued Resource ID: 38203ad5-ce82-479b-8bb4-774b4fb04634 with Priority: HIGHEST for action port [ 1083.950208] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_rules [ 1083.950208] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1083.950369] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38203ad5-ce82-479b-8bb4-774b4fb04634 with Priority: HIGHEST for action port [ 1083.954053] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.954250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.954326] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.954548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.954635] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.956374] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.956374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.956374] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-38203ad5-ce82-479b-8bb4-774b4fb04634 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.956791] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38203ad5-ce82-479b-8bb4-774b4fb04634" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.956852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38203ad5-ce82-479b-8bb4-774b4fb04634" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.957060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38203ad5-ce82-479b-8bb4-774b4fb04634" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.957144] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38203ad5-ce82-479b-8bb4-774b4fb04634',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.459271] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.459412] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.459959] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38203ad5-ce82-479b-8bb4-774b4fb04634 with status ACTIVE [ 1084.460981] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.461092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.461158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.461469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.461633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.461882] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.462014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.462014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.462150] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.462217] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.462402] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.462495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.462588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.462695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.462754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.462829] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38203ad5-ce82-479b-8bb4-774b4fb04634 is going to be updated. [ 1084.488391] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.488391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.488391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.488391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.488391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.488391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38203ad5-ce82-479b-8bb4-774b4fb04634" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.653930] env[65102]: INFO networking_nsxv3.common.synchronization [req-5a5a84b6-0373-4c60-b4cd-285fa8417934 req-44f0e264-8462-46a5-b169-5442141c0fe3 tempest-ServersTestJSON-191426844 tempest-ServersTestJSON-191426844-project-member] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1084.653930] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1084.653930] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.653930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.653930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.653930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.653930] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.653930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.653930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.653930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.653930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.654301] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.833884] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 1084.834090] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f deletion is rescheduled due to dependency. [ 1084.834212] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.834381] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.834600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.834892] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.834892] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.835027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.835148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.835209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.835297] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.976315] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.976757] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.976757] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.976875] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.977136] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.977663] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.977663] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.977663] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.977870] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.977976] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1084.978061] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1084.978166] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1084.978279] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1084.978385] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1084.978491] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1084.979054] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1084.997928] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1084.998264] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1084.998264] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1084.998547] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.998784] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-8c74ade8-3d3b-4c53-ae8e-85d8e4177ced taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.998921] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-8c74ade8-3d3b-4c53-ae8e-85d8e4177ced" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.999043] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-8c74ade8-3d3b-4c53-ae8e-85d8e4177ced" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.999421] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-8c74ade8-3d3b-4c53-ae8e-85d8e4177ced" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.999499] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c74ade8-3d3b-4c53-ae8e-85d8e4177ced',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.158231] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.337847] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.460827] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4501856-910f-4bf4-9fd2-4d3675738a94 in Status: SUCCESS [ 1085.460827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.460827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.461225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.461348] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.461477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.461551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.461736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.461834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.462736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.462736] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.502486] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.502486] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.502684] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.502949] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.503126] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.503292] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 8c74ade8-3d3b-4c53-ae8e-85d8e4177ced not found, creating... [ 1085.503693] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.503956] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.504156] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.504433] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.504586] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.504907] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.505082] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.505205] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.505430] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.505600] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.505701] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 8c74ade8-3d3b-4c53-ae8e-85d8e4177ced is going to be created. [ 1085.531044] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.531044] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.531044] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.531044] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.531372] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.531536] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-8c74ade8-3d3b-4c53-ae8e-85d8e4177ced" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.660027] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.839937] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.965242] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.163140] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.163464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.163464] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.163779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.163933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.164094] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1086.201826] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.202067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.202067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.202278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.202402] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.211705] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1086.273729] env[65102]: INFO networking_nsxv3.common.synchronization [req-5a5a84b6-0373-4c60-b4cd-285fa8417934 req-46683107-8fdf-48f0-9627-83368e62a318 service nova] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_rules [ 1086.274016] env[65102]: INFO networking_nsxv3.common.synchronization [req-5a5a84b6-0373-4c60-b4cd-285fa8417934 req-46683107-8fdf-48f0-9627-83368e62a318 service nova] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1086.274184] env[65102]: INFO networking_nsxv3.common.synchronization [req-5a5a84b6-0373-4c60-b4cd-285fa8417934 req-46683107-8fdf-48f0-9627-83368e62a318 service nova] Enqueued Resource ID: 8c74ade8-3d3b-4c53-ae8e-85d8e4177ced with Priority: HIGHEST for action port [ 1086.274814] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_rules [ 1086.275019] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1086.275193] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c74ade8-3d3b-4c53-ae8e-85d8e4177ced with Priority: HIGHEST for action port [ 1086.275586] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.275879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.275973] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.276229] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.276345] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.277448] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.278055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.278055] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c74ade8-3d3b-4c53-ae8e-85d8e4177ced taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.278055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c74ade8-3d3b-4c53-ae8e-85d8e4177ced" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.278253] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c74ade8-3d3b-4c53-ae8e-85d8e4177ced" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.278553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c74ade8-3d3b-4c53-ae8e-85d8e4177ced" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.278957] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c74ade8-3d3b-4c53-ae8e-85d8e4177ced',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.343251] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.343251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.343251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.343251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.343251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.343251] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 1086.375826] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.376035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.376145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.376435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.376631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.396043] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 1086.468794] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4501856-910f-4bf4-9fd2-4d3675738a94: rpc.has_security_group_logging(os_id): False [ 1086.487167] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.487300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.487529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.487596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.487650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.487891] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.488020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.488172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.488306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.488386] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.488478] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4501856-910f-4bf4-9fd2-4d3675738a94 is going to be created. [ 1086.554452] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.554687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.555457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.555457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.555457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.568328] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4501856-910f-4bf4-9fd2-4d3675738a94 in Status: IN_PROGRESS for 2s [ 1086.615452] env[65102]: INFO networking_nsxv3.common.synchronization [req-33367b8d-504e-47e3-8643-27111f1d8a12 req-22c7b8fe-2355-45cd-b4fe-4f2f3b5a5fbf tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_members [ 1086.616344] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_members [ 1086.616486] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.616599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.616599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.616928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.617156] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.617265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.617324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.617490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.617580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.617673] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.781610] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.781610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.781610] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c74ade8-3d3b-4c53-ae8e-85d8e4177ced with status ACTIVE [ 1086.781888] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.781888] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.781888] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.782107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.782202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.782380] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.782478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.782540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.782692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.782765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.783164] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.783164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.783164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.783328] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.783328] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.783387] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c74ade8-3d3b-4c53-ae8e-85d8e4177ced is going to be updated. [ 1086.809424] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.809586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.809659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.809879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.810060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.810240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c74ade8-3d3b-4c53-ae8e-85d8e4177ced" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.120279] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.120437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.120498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.120714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.120809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.121035] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.121195] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.121195] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.121356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.121432] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.121521] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b is going to be updated. [ 1087.158624] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.158766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.158836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.159058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.159201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.169079] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b in Status: IN_PROGRESS for 2s [ 1088.226993] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1088.227429] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.227429] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.227566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.227818] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.227971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.228064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.228270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.228666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.228666] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.408237] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 1088.408469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.408644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.408895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.410572] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.410572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.410572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.410572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.410572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.410572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.410572] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.583264] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4501856-910f-4bf4-9fd2-4d3675738a94 in Status: SUCCESS [ 1088.584067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.731911] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.913596] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.913596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.913596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.913835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.913983] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.914111] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.914178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.914339] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.914426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.914517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.914751] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.914822] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.914864] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.915018] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.915178] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.915270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.915332] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.915551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.915551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.915615] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.915986] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.188704] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b in Status: SUCCESS [ 1089.189430] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b deletion is rescheduled due to dependency. [ 1089.189430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.237780] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.418152] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a0c01bc-dc67-4824-bf8b-60c7f41f292f: rpc.has_security_group_logging(os_id): False [ 1089.437759] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.437759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.437759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.437759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.437759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.437759] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.437759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.437759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.437759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.438261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.438261] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.438261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.438261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.438382] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.438522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.439227] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.439227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.439227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.439227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.439227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.439227] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 1089.504773] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.504773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.504773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.504773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.504773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.519769] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 1089.740931] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.741445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.741445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.741445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.741628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.741674] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1089.775714] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.775714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.775714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.775714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.775714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.791138] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1090.116168] env[65102]: INFO networking_nsxv3.common.synchronization [None req-f73955c5-64e8-4eaa-95e2-fcc7314d08e0 tempest-ServerActionsTestJSON-273915797 tempest-ServerActionsTestJSON-273915797-project-member] Enqueued Resource ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 with Priority: HIGHEST for action security_group_rules [ 1090.116168] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 with Priority: HIGHEST for action security_group_rules [ 1090.116168] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.116532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.116532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.116725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.116811] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4374bed5-fea3-4dd3-b7b5-66b0f19f6284',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.295348] env[65102]: INFO networking_nsxv3.common.synchronization [None req-fe6a3b9d-2d09-4e51-bcf1-bee515a7115d tempest-ServerActionsTestJSON-273915797 tempest-ServerActionsTestJSON-273915797-project-member] Enqueued Resource ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 with Priority: HIGHEST for action security_group_rules [ 1090.296223] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 with Priority: HIGHEST for action security_group_rules [ 1090.296336] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.296442] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.642555] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.642837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.642993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.643278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.643426] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.643582] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 already deleted. [ 1090.643719] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.643993] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.644289] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.644547] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4374bed5-fea3-4dd3-b7b5-66b0f19f6284',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.166605] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.166605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.166605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.166605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.166605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.166605] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 already deleted. [ 1091.166605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.385513] env[65102]: INFO networking_nsxv3.common.synchronization [None req-ce4a2b1e-9486-4de8-9ce2-bddf8dc5abd8 None None] Enqueued Resource ID: df715995-28af-4ef0-a633-cddccfbde53d with Priority: HIGHEST for action port [ 1091.389021] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df715995-28af-4ef0-a633-cddccfbde53d with Priority: HIGHEST for action port [ 1091.389021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-df715995-28af-4ef0-a633-cddccfbde53d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.389021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df715995-28af-4ef0-a633-cddccfbde53d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.389021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df715995-28af-4ef0-a633-cddccfbde53d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.389021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df715995-28af-4ef0-a633-cddccfbde53d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.389021] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df715995-28af-4ef0-a633-cddccfbde53d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.538238] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 1091.538607] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.802659] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1091.803170] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.803533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.803798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.804024] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.804155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.804224] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.804380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.804461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.804551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.804645] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.892174] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df715995-28af-4ef0-a633-cddccfbde53d [ 1091.892540] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.892693] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.892843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.893159] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.893272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.893378] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df715995-28af-4ef0-a633-cddccfbde53d already deleted. [ 1091.893475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df715995-28af-4ef0-a633-cddccfbde53d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.311985] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.312440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.312440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.313140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.314089] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.314089] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.314089] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.314574] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.315863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.316327] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.316624] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.316718] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.316800] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.317031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.317189] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.317272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.317338] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.317492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.318354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.318354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.318354] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.821461] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8746f52-1411-469d-8df9-8b15536649f6: rpc.has_security_group_logging(os_id): False [ 1092.841490] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.841683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.841753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.841995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.842381] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.842381] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.842508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.842508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.842633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.842836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.842891] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.842983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.843181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.843181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.843263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.843444] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.843540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.843603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.843745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.843824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.843908] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1092.911613] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.911613] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.911613] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.911613] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.911613] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.928056] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1093.604904] env[65102]: INFO networking_nsxv3.common.synchronization [None req-c1960d00-c5bb-4772-9ec0-c37564272047 tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 with Priority: HIGHEST for action security_group_rules [ 1093.604904] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 with Priority: HIGHEST for action security_group_rules [ 1093.604904] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.604904] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.604904] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.604904] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.605845] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('642eb2e5-acd8-44f5-87bb-521553cbd5e2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.703204] env[65102]: INFO networking_nsxv3.common.synchronization [None req-ec8771c1-71b4-4fa4-a4a1-bdcbda0c5753 tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 with Priority: HIGHEST for action security_group_rules [ 1093.704092] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 with Priority: HIGHEST for action security_group_rules [ 1093.704902] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.704902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.913767] env[65102]: INFO networking_nsxv3.common.synchronization [None req-7deaf5d2-e18a-40e9-899d-3c46e0ab1c19 None None] Enqueued Resource ID: 084dfba0-8ac9-4e7d-8e4d-395139867ef4 with Priority: HIGHEST for action port [ 1093.914651] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 084dfba0-8ac9-4e7d-8e4d-395139867ef4 with Priority: HIGHEST for action port [ 1093.914651] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-084dfba0-8ac9-4e7d-8e4d-395139867ef4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.914811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-084dfba0-8ac9-4e7d-8e4d-395139867ef4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.914811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-084dfba0-8ac9-4e7d-8e4d-395139867ef4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.915034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-084dfba0-8ac9-4e7d-8e4d-395139867ef4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.916868] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('084dfba0-8ac9-4e7d-8e4d-395139867ef4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.137513] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.137743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.137811] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.138019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.138119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.138220] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 already deleted. [ 1094.138308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.138708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.138708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.138708] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('642eb2e5-acd8-44f5-87bb-521553cbd5e2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.419036] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 084dfba0-8ac9-4e7d-8e4d-395139867ef4 [ 1094.419350] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.419483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.419527] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.419763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.419860] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.419959] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:084dfba0-8ac9-4e7d-8e4d-395139867ef4 already deleted. [ 1094.420057] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-084dfba0-8ac9-4e7d-8e4d-395139867ef4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.659090] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.659277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.659329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.659519] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.659618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.659696] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 already deleted. [ 1094.659807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.944213] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1094.944213] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.487068] env[65102]: INFO networking_nsxv3.common.synchronization [req-e01f9363-4ca8-445f-a723-a4d4bb05e55d req-c1a12a99-48ff-4a9e-a85c-24a9204e5410 tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_members [ 1095.487880] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_members [ 1095.488215] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4501856-910f-4bf4-9fd2-4d3675738a94 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.488327] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.488400] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.488601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.488758] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.488851] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.488908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.489065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.489154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.489250] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.848375] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.848636] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.848733] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.849017] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.849389] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.849608] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.849678] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.849974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.850168] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.850378] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.850489] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.850608] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.850749] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.851307] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.851307] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.851307] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.873298] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.873461] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.873919] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.873919] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.874137] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-d04b7a1c-d3b0-4211-b44b-2e39791f7497 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.874565] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-d04b7a1c-d3b0-4211-b44b-2e39791f7497" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.875315] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-d04b7a1c-d3b0-4211-b44b-2e39791f7497" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.875315] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-d04b7a1c-d3b0-4211-b44b-2e39791f7497" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.875315] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d04b7a1c-d3b0-4211-b44b-2e39791f7497',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.991353] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.378070] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.378411] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.378557] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.378910] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.379114] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.379269] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port d04b7a1c-d3b0-4211-b44b-2e39791f7497 not found, creating... [ 1096.379552] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.379721] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.379840] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.380132] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.380304] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.380717] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.380899] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.381164] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.381406] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.381561] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.381756] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: d04b7a1c-d3b0-4211-b44b-2e39791f7497 is going to be created. [ 1096.402244] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.402561] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.402818] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.403139] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.403455] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.403748] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-d04b7a1c-d3b0-4211-b44b-2e39791f7497" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.493811] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.572351] env[65102]: INFO networking_nsxv3.common.synchronization [req-226d9b72-7250-4c1a-9cab-e60460654271 req-0bf9a633-48de-417c-977d-0c25a91bbb6e tempest-ServerRescueNegativeTestJSON-286642771 tempest-ServerRescueNegativeTestJSON-286642771-project-member] Enqueued Resource ID: 5476d54c-8894-4aeb-b26c-f1637341e27f with Priority: HIGHEST for action security_group_members [ 1096.572929] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5476d54c-8894-4aeb-b26c-f1637341e27f with Priority: HIGHEST for action security_group_members [ 1096.573272] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-5476d54c-8894-4aeb-b26c-f1637341e27f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.573438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.573537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.573701] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.573892] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.574039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.574122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.574322] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.574430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.574613] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5476d54c-8894-4aeb-b26c-f1637341e27f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.996467] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.996824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.996863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.997112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.997206] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.997309] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4501856-910f-4bf4-9fd2-4d3675738a94 is going to be updated. [ 1097.029899] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.030142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.030142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.030330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.030483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.040494] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4501856-910f-4bf4-9fd2-4d3675738a94 in Status: IN_PROGRESS for 2s [ 1097.076997] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.077169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.077251] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.077478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.101055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.102519] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.102657] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.102722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.102937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.103030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.103135] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5476d54c-8894-4aeb-b26c-f1637341e27f is going to be updated. [ 1097.107682] env[65102]: INFO networking_nsxv3.common.synchronization [req-e01f9363-4ca8-445f-a723-a4d4bb05e55d req-5bb95198-8837-4614-ae25-1b85ed612ef1 service nova] Enqueued Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_rules [ 1097.107771] env[65102]: INFO networking_nsxv3.common.synchronization [req-e01f9363-4ca8-445f-a723-a4d4bb05e55d req-5bb95198-8837-4614-ae25-1b85ed612ef1 service nova] Enqueued Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_members [ 1097.107872] env[65102]: INFO networking_nsxv3.common.synchronization [req-e01f9363-4ca8-445f-a723-a4d4bb05e55d req-5bb95198-8837-4614-ae25-1b85ed612ef1 service nova] Enqueued Resource ID: d04b7a1c-d3b0-4211-b44b-2e39791f7497 with Priority: HIGHEST for action port [ 1097.108374] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_rules [ 1097.108508] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_members [ 1097.108609] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d04b7a1c-d3b0-4211-b44b-2e39791f7497 with Priority: HIGHEST for action port [ 1097.108948] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4501856-910f-4bf4-9fd2-4d3675738a94 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.109041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.109041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.109240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.109319] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.110238] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4501856-910f-4bf4-9fd2-4d3675738a94 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.110238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.110412] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d04b7a1c-d3b0-4211-b44b-2e39791f7497 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.110506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d04b7a1c-d3b0-4211-b44b-2e39791f7497" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.110569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d04b7a1c-d3b0-4211-b44b-2e39791f7497" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.110731] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d04b7a1c-d3b0-4211-b44b-2e39791f7497" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.110806] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d04b7a1c-d3b0-4211-b44b-2e39791f7497',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.133339] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.133595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.133595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.133790] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.133875] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.145027] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5476d54c-8894-4aeb-b26c-f1637341e27f in Status: IN_PROGRESS for 2s [ 1097.612920] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4501856-910f-4bf4-9fd2-4d3675738a94 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.613079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.613263] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d04b7a1c-d3b0-4211-b44b-2e39791f7497 with status ACTIVE [ 1097.613505] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.613616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.613684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.613891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.613983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.614210] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.614309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.614371] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.614527] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.614607] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.614788] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.615335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.615438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.615651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.615725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.615814] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d04b7a1c-d3b0-4211-b44b-2e39791f7497 is going to be updated. [ 1097.638982] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.639190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.639238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.639488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.639665] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.639958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d04b7a1c-d3b0-4211-b44b-2e39791f7497" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.858970] env[65102]: INFO networking_nsxv3.common.synchronization [req-d3533f4a-d596-46dd-ba5e-ed1feea9942f req-5e9acf61-4fc2-4209-ae26-6008957a1e20 tempest-ServerActionsTestJSON-273915797 tempest-ServerActionsTestJSON-273915797-project-member] Enqueued Resource ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 with Priority: HIGHEST for action security_group_members [ 1097.859637] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 with Priority: HIGHEST for action security_group_members [ 1097.859963] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.860094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.860158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.860413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.860590] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.860732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.860802] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.861081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.861081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.861180] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4374bed5-fea3-4dd3-b7b5-66b0f19f6284',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.240566] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.240922] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.241053] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.241373] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.241700] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.241943] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.242126] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.242413] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.242593] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.242839] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.242925] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.243055] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.243167] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.243290] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.243423] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.243558] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1098.265114] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1098.265346] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1098.265572] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1098.265794] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.266404] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-429e11fc-b198-49e7-bce8-d832c0a6d038 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.266579] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-429e11fc-b198-49e7-bce8-d832c0a6d038" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.266579] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-429e11fc-b198-49e7-bce8-d832c0a6d038" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.267023] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-429e11fc-b198-49e7-bce8-d832c0a6d038" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.267217] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('429e11fc-b198-49e7-bce8-d832c0a6d038',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.363741] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.363932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.363981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.364248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.364343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.364550] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.364661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.364723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.364881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.364965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.365071] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 already deleted. [ 1098.365538] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.770217] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.770571] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.770752] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.771733] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.771733] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.771733] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 429e11fc-b198-49e7-bce8-d832c0a6d038 not found, creating... [ 1098.771733] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.771936] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.772089] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.772336] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.772483] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.772778] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.772936] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.773070] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.773284] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.773423] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.773564] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 429e11fc-b198-49e7-bce8-d832c0a6d038 is going to be created. [ 1098.795753] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.796048] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.796201] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.796472] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.796701] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.796925] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-429e11fc-b198-49e7-bce8-d832c0a6d038" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.052132] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4501856-910f-4bf4-9fd2-4d3675738a94 in Status: SUCCESS [ 1099.052371] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.052599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.052777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.053101] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.053101] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.053225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.053311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.053389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.053568] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.154598] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5476d54c-8894-4aeb-b26c-f1637341e27f in Status: SUCCESS [ 1099.154792] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5476d54c-8894-4aeb-b26c-f1637341e27f deletion is rescheduled due to dependency. [ 1099.154907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5476d54c-8894-4aeb-b26c-f1637341e27f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.287464] env[65102]: INFO networking_nsxv3.common.synchronization [req-7d08969c-4880-41a5-91b5-ef14983ef5f2 req-a4f61452-a3f2-40c7-a019-734ce569613c tempest-ServersTestJSON-191426844 tempest-ServersTestJSON-191426844-project-member] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1099.288465] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1099.288810] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.288932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.289040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.289294] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.289442] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.289490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.289559] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.289709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.289795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.289890] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.539484] env[65102]: INFO networking_nsxv3.common.synchronization [req-d3533f4a-d596-46dd-ba5e-ed1feea9942f req-98dc1150-0525-4718-b116-d62ce17b67ef service nova] Enqueued Resource ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 with Priority: HIGHEST for action security_group_rules [ 1099.539670] env[65102]: INFO networking_nsxv3.common.synchronization [req-d3533f4a-d596-46dd-ba5e-ed1feea9942f req-98dc1150-0525-4718-b116-d62ce17b67ef service nova] Enqueued Resource ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 with Priority: HIGHEST for action security_group_members [ 1099.539809] env[65102]: INFO networking_nsxv3.common.synchronization [req-d3533f4a-d596-46dd-ba5e-ed1feea9942f req-98dc1150-0525-4718-b116-d62ce17b67ef service nova] Enqueued Resource ID: 429e11fc-b198-49e7-bce8-d832c0a6d038 with Priority: HIGHEST for action port [ 1099.540356] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 with Priority: HIGHEST for action security_group_rules [ 1099.540490] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 with Priority: HIGHEST for action security_group_members [ 1099.540586] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 429e11fc-b198-49e7-bce8-d832c0a6d038 with Priority: HIGHEST for action port [ 1099.540856] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.540977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.541118] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.541323] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.541391] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4374bed5-fea3-4dd3-b7b5-66b0f19f6284',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.542242] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.542356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.542431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.542581] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.542727] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.542813] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.542875] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.543029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.543148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.543200] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4374bed5-fea3-4dd3-b7b5-66b0f19f6284',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.543952] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-429e11fc-b198-49e7-bce8-d832c0a6d038 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.544087] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-429e11fc-b198-49e7-bce8-d832c0a6d038" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.544129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-429e11fc-b198-49e7-bce8-d832c0a6d038" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.544274] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-429e11fc-b198-49e7-bce8-d832c0a6d038" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.544344] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('429e11fc-b198-49e7-bce8-d832c0a6d038',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.555977] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.792641] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.046188] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.046495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.046585] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4374bed5-fea3-4dd3-b7b5-66b0f19f6284',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.047705] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 429e11fc-b198-49e7-bce8-d832c0a6d038 with status ACTIVE [ 1100.047705] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.047843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.047843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.048080] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.048140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.048318] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.048422] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.048488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.048669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.048758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.049172] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.049294] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.049376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.049650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.049693] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.049834] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 429e11fc-b198-49e7-bce8-d832c0a6d038 is going to be updated. [ 1100.060402] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.073158] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.073365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.073489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.073706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.073950] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.074186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-429e11fc-b198-49e7-bce8-d832c0a6d038" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.294957] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.311516] env[65102]: INFO networking_nsxv3.common.synchronization [req-5472a5cc-8f38-44a3-adb8-38c45ecee77d req-13b1eb90-2039-4747-9aef-cc18d29f0c67 tempest-ServerRescueTestJSON-675599107 tempest-ServerRescueTestJSON-675599107-project-member] Enqueued Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_members [ 1100.312330] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_members [ 1100.312696] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.312837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.312928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.313169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.313401] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.313528] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.313633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.313824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.314433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.314433] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.552422] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4374bed5-fea3-4dd3-b7b5-66b0f19f6284',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.562633] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.562751] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.562823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.563048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.563139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.563235] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4501856-910f-4bf4-9fd2-4d3675738a94 is going to be updated. [ 1100.603693] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.603881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.603954] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.604198] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.604354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.613501] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4501856-910f-4bf4-9fd2-4d3675738a94 in Status: IN_PROGRESS for 2s [ 1100.647843] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-378 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.648070] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-378" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.648197] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-378" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.648501] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-378" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.648725] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.648884] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.649011] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.649465] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.649631] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.649846] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.649999] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.650079] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.650204] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.650299] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.650408] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.650545] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1100.670168] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1100.670168] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1100.670168] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1100.670406] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-378" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.670622] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.670800] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.670920] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.671288] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.671432] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.797498] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.797498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.797498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.797699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.797699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.797885] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1100.817456] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.831025] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.831025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.831025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.831025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.831025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.842488] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1101.055234] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.055461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.055566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.055780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.055875] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.055986] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 is going to be created. [ 1101.080738] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.081058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.081058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.081194] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.081332] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.090575] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 in Status: UNINITIALIZED for 2s [ 1101.174025] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.174404] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.174523] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.175024] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.175329] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.175802] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5 not found, creating... [ 1101.175965] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.176248] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.176518] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.177026] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.177285] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.177815] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.178110] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.178383] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.178758] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.179057] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.179330] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5 is going to be created. [ 1101.203942] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.204253] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.204416] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.204726] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.205061] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.205411] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.321436] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.824356] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.824532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.824570] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.824814] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.824907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.825017] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d17fda10-7148-4558-b429-6c6b75b5f20d is going to be updated. [ 1101.866220] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.866503] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.866665] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.867131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.867329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.880188] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d17fda10-7148-4558-b429-6c6b75b5f20d in Status: IN_PROGRESS for 2s [ 1101.914291] env[65102]: INFO networking_nsxv3.common.synchronization [req-5472a5cc-8f38-44a3-adb8-38c45ecee77d req-2236f294-24b9-4c3b-8121-55f629426dca service nova] Enqueued Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_rules [ 1101.914545] env[65102]: INFO networking_nsxv3.common.synchronization [req-5472a5cc-8f38-44a3-adb8-38c45ecee77d req-2236f294-24b9-4c3b-8121-55f629426dca service nova] Enqueued Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_members [ 1101.914740] env[65102]: INFO networking_nsxv3.common.synchronization [req-5472a5cc-8f38-44a3-adb8-38c45ecee77d req-2236f294-24b9-4c3b-8121-55f629426dca service nova] Enqueued Resource ID: 1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5 with Priority: HIGHEST for action port [ 1101.915649] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_rules [ 1101.915814] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_members [ 1101.915940] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5 with Priority: HIGHEST for action port [ 1101.916332] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.916486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.916604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.916810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.916912] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.918365] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.918365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.918537] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.918635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.918721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.918986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.919051] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.422543] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.422821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.422884] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5 with status ACTIVE [ 1102.423046] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.423158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.423221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.423434] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.423522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.424512] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.424512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.424512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.424512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.424512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.424512] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.424512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.424512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.424512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.424914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.424914] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5 is going to be updated. [ 1102.447697] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.447885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.447970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.448182] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.448310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.448468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1299e0ad-03f4-4023-bc6d-5fd1c1c1a5f5" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.623675] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4501856-910f-4bf4-9fd2-4d3675738a94 in Status: SUCCESS [ 1102.624516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.624516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.624516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.624516] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.624718] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.624718] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.625809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.625809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.625809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.625809] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.750614] env[65102]: INFO networking_nsxv3.common.synchronization [req-f3f1f3bb-1fef-4af5-bef4-c273dd8d57d6 req-ee880950-5bdb-4d84-9c09-6f6635f0196f tempest-ImagesOneServerNegativeTestJSON-1910886864 tempest-ImagesOneServerNegativeTestJSON-1910886864-project-member] Enqueued Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1102.750614] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1102.751093] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.751372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.751540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.751919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.752209] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.752747] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.752991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.753255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.753424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.753612] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.851566] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1102.851787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.105944] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 in Status: SUCCESS [ 1103.105944] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.105944] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.105944] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.106186] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.106264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.106312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.106504] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.106823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.106823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.106823] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4374bed5-fea3-4dd3-b7b5-66b0f19f6284',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.127801] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.256797] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.256965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.257053] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.257283] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.257378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.257614] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.257753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.257818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.257990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.258086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.258180] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c already deleted. [ 1103.258261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.562657] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.562997] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-844" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.563377] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-844" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.563728] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-844" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.564057] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.564277] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.564435] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.564699] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.565098] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.565098] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1103.565314] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1103.565453] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1103.565620] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1103.565783] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1103.565932] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1103.566117] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1103.586837] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1103.587335] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1103.589835] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1103.590068] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-844" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.590432] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-c1980f33-8ad2-41e3-96b5-8ea42f4c3399 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.590701] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-c1980f33-8ad2-41e3-96b5-8ea42f4c3399" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.590834] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-c1980f33-8ad2-41e3-96b5-8ea42f4c3399" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.591171] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-c1980f33-8ad2-41e3-96b5-8ea42f4c3399" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.591309] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1980f33-8ad2-41e3-96b5-8ea42f4c3399',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.609974] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4374bed5-fea3-4dd3-b7b5-66b0f19f6284',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.630586] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4501856-910f-4bf4-9fd2-4d3675738a94: rpc.has_security_group_logging(os_id): False [ 1103.650874] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.651115] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.651158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.651567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.651567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.651707] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.651833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.651881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.652029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.652108] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.652393] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4501856-910f-4bf4-9fd2-4d3675738a94 is going to be updated. [ 1103.716431] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.716666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.716777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.717096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.717330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.735151] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4501856-910f-4bf4-9fd2-4d3675738a94 in Status: IN_PROGRESS for 2s [ 1103.893540] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d17fda10-7148-4558-b429-6c6b75b5f20d in Status: SUCCESS [ 1103.893540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.893774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.894031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.894275] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.894391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.894498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.894648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.894750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.894845] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.094096] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.094353] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.094484] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.094787] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.094939] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.095131] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port c1980f33-8ad2-41e3-96b5-8ea42f4c3399 not found, creating... [ 1104.095475] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.095664] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.095779] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.096036] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.096231] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.096543] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.096726] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.096841] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.103952] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.104357] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.104632] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: c1980f33-8ad2-41e3-96b5-8ea42f4c3399 is going to be created. [ 1104.114436] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4374bed5-fea3-4dd3-b7b5-66b0f19f6284: rpc.has_security_group_logging(os_id): False [ 1104.128645] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.128936] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.128936] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.129177] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.129504] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.129753] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-c1980f33-8ad2-41e3-96b5-8ea42f4c3399" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.135079] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.135218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.135382] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.135600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.135689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.135996] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.136116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.136205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.136448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.136550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.136662] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 is going to be created. [ 1104.216332] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.216607] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.216683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.216944] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.217149] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.248653] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 in Status: IN_PROGRESS for 2s [ 1104.397616] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.823017] env[65102]: INFO networking_nsxv3.common.synchronization [req-f3f1f3bb-1fef-4af5-bef4-c273dd8d57d6 req-2a461565-4d60-43e3-acac-1f987251757b service nova] Enqueued Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_rules [ 1104.823017] env[65102]: INFO networking_nsxv3.common.synchronization [req-f3f1f3bb-1fef-4af5-bef4-c273dd8d57d6 req-2a461565-4d60-43e3-acac-1f987251757b service nova] Enqueued Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1104.823017] env[65102]: INFO networking_nsxv3.common.synchronization [req-f3f1f3bb-1fef-4af5-bef4-c273dd8d57d6 req-2a461565-4d60-43e3-acac-1f987251757b service nova] Enqueued Resource ID: c1980f33-8ad2-41e3-96b5-8ea42f4c3399 with Priority: HIGHEST for action port [ 1104.823427] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_rules [ 1104.823641] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1104.823752] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1980f33-8ad2-41e3-96b5-8ea42f4c3399 with Priority: HIGHEST for action port [ 1104.824089] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.824211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.824386] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.824577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.824617] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.825519] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.825647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.825717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.826339] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.826339] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.826339] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.826339] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.826566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.826566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.826566] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.827420] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1980f33-8ad2-41e3-96b5-8ea42f4c3399 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.827518] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1980f33-8ad2-41e3-96b5-8ea42f4c3399" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.827601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1980f33-8ad2-41e3-96b5-8ea42f4c3399" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.827755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1980f33-8ad2-41e3-96b5-8ea42f4c3399" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.827831] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1980f33-8ad2-41e3-96b5-8ea42f4c3399',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.900272] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.329383] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.330548] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.330694] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.331149] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1980f33-8ad2-41e3-96b5-8ea42f4c3399 with status ACTIVE [ 1105.331361] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.331543] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.331650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.331866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.331957] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.332152] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.332331] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.332377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.332535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.332609] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.332789] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.332881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.332941] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.333092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.333168] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.333333] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1980f33-8ad2-41e3-96b5-8ea42f4c3399 is going to be updated. [ 1105.356185] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.356389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.356389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.356798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.356983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.357177] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1980f33-8ad2-41e3-96b5-8ea42f4c3399" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.402361] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.402605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.402649] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.402885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.403014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.403145] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d17fda10-7148-4558-b429-6c6b75b5f20d is going to be updated. [ 1105.433772] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.433772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.433772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.433772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.434082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.445159] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d17fda10-7148-4558-b429-6c6b75b5f20d in Status: IN_PROGRESS for 2s [ 1105.775930] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4501856-910f-4bf4-9fd2-4d3675738a94 in Status: SUCCESS [ 1105.775930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.807524] env[65102]: INFO networking_nsxv3.common.synchronization [req-3f7c73e9-e5c2-4d7a-9043-691de27d3388 req-1eeb6887-4ed8-4d71-9995-d4e691487281 tempest-ServerActionsTestOtherB-1046242315 tempest-ServerActionsTestOtherB-1046242315-project-member] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 1105.807524] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 1105.808051] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.808384] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.808836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.809166] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.809497] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.809712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.809883] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.810341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.810619] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.811857] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.832125] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.265726] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 in Status: SUCCESS [ 1106.266102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.314867] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.315078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.315135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.315497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.315620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.315976] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.316182] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.316285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.316520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.316613] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.316768] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be updated. [ 1106.334807] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.335044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.335418] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.335418] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.335701] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.335701] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c is going to be created. [ 1106.355992] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.357744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.357910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.358164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.360155] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.369474] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.369699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.369902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.370301] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.370888] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.372774] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: IN_PROGRESS for 2s [ 1106.417276] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: UNINITIALIZED for 2s [ 1107.456358] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d17fda10-7148-4558-b429-6c6b75b5f20d in Status: SUCCESS [ 1107.456632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.456828] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.457074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.457316] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.457444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.457511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.457730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.457849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.457947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.458087] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.870067] env[65102]: INFO networking_nsxv3.common.synchronization [None req-7907df2d-6b18-4adb-ba34-28bd3197ba56 tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1107.870403] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1107.870933] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.870933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.871073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.871373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.871439] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.871537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.871615] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.871837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.871934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.872075] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.960234] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.960390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.960539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.964020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.964020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.964020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.964020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.964020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.964020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.964020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.964020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.964020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.964020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.964020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.964020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.964020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.964020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.964020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.964020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.964020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.964020] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.982267] env[65102]: INFO networking_nsxv3.common.synchronization [req-4b2d6aee-fd95-4b02-bcba-458aa1bacc75 req-b1a224c4-b447-4b5d-b721-899c18b6fad7 tempest-AttachVolumeShelveTestJSON-733143698 tempest-AttachVolumeShelveTestJSON-733143698-project-member] Enqueued Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_members [ 1107.983800] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01880e80-b093-4590-b2d1-b15567f49135 with Priority: HIGHEST for action security_group_members [ 1107.984486] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-01880e80-b093-4590-b2d1-b15567f49135 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.984739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.984902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.985205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.985490] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.985843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.986047] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.986287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.986526] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.986742] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01880e80-b093-4590-b2d1-b15567f49135',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.242607] env[65102]: INFO networking_nsxv3.common.synchronization [req-e406208c-acfe-4482-890f-356240ae8700 req-aacdb5d6-7b67-4cc2-bef9-4da7d686a3dd tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 with Priority: HIGHEST for action security_group_members [ 1108.244716] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 with Priority: HIGHEST for action security_group_members [ 1108.245666] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-642eb2e5-acd8-44f5-87bb-521553cbd5e2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.246378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.246378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.246378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.246667] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.246762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.246919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.247233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.247386] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.247552] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('642eb2e5-acd8-44f5-87bb-521553cbd5e2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.377085] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.377085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.377085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.377284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.377390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.377637] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.377756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.378446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.378531] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.378635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.378734] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1108.393371] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 1108.393547] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 deletion is rescheduled due to dependency. [ 1108.393635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.411099] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.412597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.412597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.412597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.412597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.422865] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1108.428153] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: SUCCESS [ 1108.428153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.428153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.428153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.428153] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.428153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.428153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.428153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.428153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.428153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.428153] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.465092] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d17fda10-7148-4558-b429-6c6b75b5f20d: rpc.has_security_group_logging(os_id): False [ 1108.482698] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.482848] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.482919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.483170] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.483245] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.483435] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.483536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.483599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.483746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.483825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.484030] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.484127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.484189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.484372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.484529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.484582] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.484673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.484733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.484869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.484944] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.485049] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d17fda10-7148-4558-b429-6c6b75b5f20d is going to be updated. [ 1108.489028] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.489153] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.489215] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.489381] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.515955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.515955] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.515955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.515955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.516327] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.516327] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.516327] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01880e80-b093-4590-b2d1-b15567f49135 is going to be updated. [ 1108.550764] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.550847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.550881] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.551211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.551258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.562274] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01880e80-b093-4590-b2d1-b15567f49135 in Status: IN_PROGRESS for 2s [ 1108.568288] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.568446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.568598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.568709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.568854] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.582815] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d17fda10-7148-4558-b429-6c6b75b5f20d in Status: IN_PROGRESS for 2s [ 1108.619023] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.619023] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.619023] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.619023] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.619518] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.619822] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.620047] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.620356] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.620602] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.620898] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1108.621212] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1108.621413] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1108.622106] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1108.622106] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1108.622106] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1108.622106] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1108.648025] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1108.648025] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1108.648025] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1108.648025] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.648025] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-40c68565-653b-4c27-83db-52fff0de54f0 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.648025] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-40c68565-653b-4c27-83db-52fff0de54f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.648025] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-40c68565-653b-4c27-83db-52fff0de54f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.648025] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-40c68565-653b-4c27-83db-52fff0de54f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.648025] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40c68565-653b-4c27-83db-52fff0de54f0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.751583] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.751583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.751583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.751583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.751824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.751942] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.752106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.752199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.752438] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.752592] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.752689] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 already deleted. [ 1108.752807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.931258] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.931414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.931480] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.931742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.931923] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.932113] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.932195] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.932376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.932466] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.932797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.932797] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.932797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.932911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.932973] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.933159] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.933255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.933320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.933466] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.933545] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.933620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.933704] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.151876] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.152172] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.152310] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.152574] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.152733] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.152869] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 40c68565-653b-4c27-83db-52fff0de54f0 not found, creating... [ 1109.153174] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.153355] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.153482] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.153723] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.153891] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.154232] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.154398] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.154513] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.154979] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.154979] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.155136] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 40c68565-653b-4c27-83db-52fff0de54f0 is going to be created. [ 1109.181964] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.182366] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.182422] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.182900] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.182988] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.183530] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-40c68565-653b-4c27-83db-52fff0de54f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.439149] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0f8a62e-96a1-4434-a694-20df67619d3c: rpc.has_security_group_logging(os_id): False [ 1109.463658] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.463926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.463926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.464260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.464390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.464650] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.464801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.464889] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.465112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.465512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.465815] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.465963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.466058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.466703] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.466703] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.466703] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.466878] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.466878] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.466957] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.467043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.467134] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c is going to be created. [ 1109.543367] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.543536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.543536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.543741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.543927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.555520] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: IN_PROGRESS for 2s [ 1109.889445] env[65102]: INFO networking_nsxv3.common.synchronization [req-e406208c-acfe-4482-890f-356240ae8700 req-28a18b3e-7f85-41f0-b0fc-f1895fa807ac service nova] Enqueued Resource ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 with Priority: HIGHEST for action security_group_rules [ 1109.889445] env[65102]: INFO networking_nsxv3.common.synchronization [req-e406208c-acfe-4482-890f-356240ae8700 req-28a18b3e-7f85-41f0-b0fc-f1895fa807ac service nova] Enqueued Resource ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 with Priority: HIGHEST for action security_group_members [ 1109.889445] env[65102]: INFO networking_nsxv3.common.synchronization [req-e406208c-acfe-4482-890f-356240ae8700 req-28a18b3e-7f85-41f0-b0fc-f1895fa807ac service nova] Enqueued Resource ID: 40c68565-653b-4c27-83db-52fff0de54f0 with Priority: HIGHEST for action port [ 1109.889972] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 with Priority: HIGHEST for action security_group_rules [ 1109.890122] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 with Priority: HIGHEST for action security_group_members [ 1109.890223] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40c68565-653b-4c27-83db-52fff0de54f0 with Priority: HIGHEST for action port [ 1109.890886] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.890886] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.890886] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.890886] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.891169] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('642eb2e5-acd8-44f5-87bb-521553cbd5e2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.891827] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-642eb2e5-acd8-44f5-87bb-521553cbd5e2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.891938] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.892010] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.892398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.892564] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.892662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.892725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.892870] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.892974] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.894278] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('642eb2e5-acd8-44f5-87bb-521553cbd5e2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.896548] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-40c68565-653b-4c27-83db-52fff0de54f0 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.896657] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40c68565-653b-4c27-83db-52fff0de54f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.896723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40c68565-653b-4c27-83db-52fff0de54f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.896923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40c68565-653b-4c27-83db-52fff0de54f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.897045] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40c68565-653b-4c27-83db-52fff0de54f0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.397450] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('642eb2e5-acd8-44f5-87bb-521553cbd5e2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.398678] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-642eb2e5-acd8-44f5-87bb-521553cbd5e2 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.398793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.398948] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40c68565-653b-4c27-83db-52fff0de54f0 with status ACTIVE [ 1110.399128] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.399238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.399306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.399508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.399597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.399797] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.399907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.399970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.400140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.400220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.400403] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.400496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.400557] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.400693] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.400766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.400849] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40c68565-653b-4c27-83db-52fff0de54f0 is going to be updated. [ 1110.424026] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.424203] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.424241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.424445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.424580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.424736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40c68565-653b-4c27-83db-52fff0de54f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.433281] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1110.433524] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f deletion is rescheduled due to dependency. [ 1110.433656] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.572520] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01880e80-b093-4590-b2d1-b15567f49135 in Status: SUCCESS [ 1110.572520] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01880e80-b093-4590-b2d1-b15567f49135 deletion is rescheduled due to dependency. [ 1110.572520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01880e80-b093-4590-b2d1-b15567f49135" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.597038] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d17fda10-7148-4558-b429-6c6b75b5f20d in Status: SUCCESS [ 1110.597038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.902663] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('642eb2e5-acd8-44f5-87bb-521553cbd5e2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.405962] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.405962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.405962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.405962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.405962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.405962] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 is going to be created. [ 1111.432058] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.432058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.432058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.432058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.432058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.441955] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 in Status: UNINITIALIZED for 2s [ 1111.568078] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: SUCCESS [ 1111.568295] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.452903] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 in Status: SUCCESS [ 1113.453200] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.453373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.453645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.453810] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.453930] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.453996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.454173] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.454256] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.454341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.454431] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('642eb2e5-acd8-44f5-87bb-521553cbd5e2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.957938] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('642eb2e5-acd8-44f5-87bb-521553cbd5e2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.413890] env[65102]: INFO networking_nsxv3.common.synchronization [req-29858c9f-9059-408a-a927-a2345db84177 req-de25737c-f2d5-4d74-a6ed-7c72cf71105b tempest-DeleteServersTestJSON-1773899535 tempest-DeleteServersTestJSON-1773899535-project-member] Enqueued Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 1114.414569] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f with Priority: HIGHEST for action security_group_members [ 1114.414952] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-99c8f96e-2cdb-49cd-8847-bf7698ff539f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.415064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.415064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.415359] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.415528] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.415647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.415708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.415866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.415954] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.416064] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('99c8f96e-2cdb-49cd-8847-bf7698ff539f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.461700] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 642eb2e5-acd8-44f5-87bb-521553cbd5e2: rpc.has_security_group_logging(os_id): False [ 1114.480528] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.480688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.480729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.480943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.481042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.481291] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.481394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.481462] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.481639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.481710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.481798] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 is going to be created. [ 1114.547385] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.547645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.547645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.547972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.548231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.562233] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 in Status: IN_PROGRESS for 2s [ 1114.856883] env[65102]: INFO networking_nsxv3.common.synchronization [req-02cfeda2-3587-4912-aafe-93cc35ac04ff req-9d9fa8df-c7d1-40cd-a978-f82024ca6ac5 tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 with Priority: HIGHEST for action security_group_members [ 1114.857501] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 with Priority: HIGHEST for action security_group_members [ 1114.857829] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6a6e2c1-d834-4eaf-b515-26c83f090350 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.858027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.858061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.858331] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.858501] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.858603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.858667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.858829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.858916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.859011] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6a6e2c1-d834-4eaf-b515-26c83f090350',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.919504] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.919729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.919819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.919989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.920098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.920323] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.920445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.920520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.920683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.920775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.920875] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f is going to be updated. [ 1114.950972] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.951269] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.951608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.951608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.951883] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.963166] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: IN_PROGRESS for 2s [ 1115.360819] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.360973] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.361058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.361284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.387333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.387643] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.387784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.387844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.388045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.388186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.388225] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 is going to be updated. [ 1115.423020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.423279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.423326] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.423572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.425036] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.436914] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 in Status: IN_PROGRESS for 2s [ 1115.766014] env[65102]: INFO networking_nsxv3.common.synchronization [None req-12313add-5141-4c2d-9b7f-d8d48b548381 tempest-AttachVolumeShelveTestJSON-733143698 tempest-AttachVolumeShelveTestJSON-733143698-project-member] Enqueued Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_rules [ 1115.766902] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_rules [ 1115.766902] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0807565d-e6cc-4e93-b299-cd44c8892eaa taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.769031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.769031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.769031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.769031] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.853691] env[65102]: INFO networking_nsxv3.common.synchronization [None req-354f2f3f-562e-4408-b3c8-aa6ce8bbba7b tempest-AttachVolumeShelveTestJSON-733143698 tempest-AttachVolumeShelveTestJSON-733143698-project-member] Enqueued Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_rules [ 1115.853895] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_rules [ 1115.854359] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0807565d-e6cc-4e93-b299-cd44c8892eaa taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.854724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.301106] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.301273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.301337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.301579] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.301670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.301765] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa already deleted. [ 1116.301859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.302317] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.302493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.302589] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.578132] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 in Status: SUCCESS [ 1116.578488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.824821] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.825159] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.825159] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.825375] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.825417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.825493] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa already deleted. [ 1116.825578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.973847] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f in Status: SUCCESS [ 1116.974111] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 99c8f96e-2cdb-49cd-8847-bf7698ff539f deletion is rescheduled due to dependency. [ 1116.974255] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-99c8f96e-2cdb-49cd-8847-bf7698ff539f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.446351] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 in Status: SUCCESS [ 1117.446637] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6a6e2c1-d834-4eaf-b515-26c83f090350 deletion is rescheduled due to dependency. [ 1117.446825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6a6e2c1-d834-4eaf-b515-26c83f090350" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.434678] env[65102]: INFO networking_nsxv3.common.synchronization [req-d012a2ba-586c-476f-ac5d-6a3aaba782b1 req-2b48949a-c5cd-4121-a937-26ae1ea50bfb tempest-ServerRescueNegativeTestJSON-286642771 tempest-ServerRescueNegativeTestJSON-286642771-project-member] Enqueued Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_members [ 1119.434678] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_members [ 1119.435122] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e683108f-84a0-4d62-934c-58f2999656a4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.435228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.435299] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.435474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.435674] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.435789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.435864] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.436079] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.436224] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.436321] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.940159] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.442977] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.945728] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.945924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.945924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.946181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.946272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.946383] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e683108f-84a0-4d62-934c-58f2999656a4 is going to be updated. [ 1120.985908] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.986794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.986977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.987291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.987501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.998542] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e683108f-84a0-4d62-934c-58f2999656a4 in Status: IN_PROGRESS for 2s [ 1121.220475] env[65102]: INFO networking_nsxv3.common.synchronization [None req-0bca85f5-3dac-4d1d-b18f-38e51fec124c tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: 43c26daa-d251-465e-af14-279e7838d2a3 with Priority: HIGHEST for action security_group_rules [ 1121.221431] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c26daa-d251-465e-af14-279e7838d2a3 with Priority: HIGHEST for action security_group_rules [ 1121.221928] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43c26daa-d251-465e-af14-279e7838d2a3 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.222119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.224094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.224094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.224094] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43c26daa-d251-465e-af14-279e7838d2a3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.354535] env[65102]: INFO networking_nsxv3.common.synchronization [None req-2512618d-7b29-4132-9963-29bb9fc9b12b tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: 43c26daa-d251-465e-af14-279e7838d2a3 with Priority: HIGHEST for action security_group_rules [ 1121.355102] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c26daa-d251-465e-af14-279e7838d2a3 with Priority: HIGHEST for action security_group_rules [ 1121.355345] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43c26daa-d251-465e-af14-279e7838d2a3 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.355450] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.750201] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.750201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.750201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.750201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.750201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.750201] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43c26daa-d251-465e-af14-279e7838d2a3 already deleted. [ 1121.750201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.750201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.750201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.750201] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43c26daa-d251-465e-af14-279e7838d2a3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.290420] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.291299] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.291299] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.291299] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.291299] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.291564] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43c26daa-d251-465e-af14-279e7838d2a3 already deleted. [ 1122.291564] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.009706] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e683108f-84a0-4d62-934c-58f2999656a4 in Status: SUCCESS [ 1123.010117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.130569] env[65102]: INFO networking_nsxv3.common.synchronization [req-19646250-1c92-44e2-8bd8-40af895be976 req-cc2e09df-53ef-4426-a93e-e57c135fe0f1 tempest-ServersTestJSON-191426844 tempest-ServersTestJSON-191426844-project-member] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1123.132198] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1123.132648] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.132823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.132922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.133208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.133378] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.133487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.133588] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.133773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.133869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.133970] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.640256] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.705022] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.705022] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.705022] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.705022] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.705441] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.705781] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.706100] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.706427] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.706712] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.708036] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.708271] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.708919] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.708919] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.708919] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.708919] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.709129] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.728814] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.728926] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1123.730043] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.730043] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.730043] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-c0845e53-b126-43de-a3da-5356c9c0a9c7 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.730043] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-c0845e53-b126-43de-a3da-5356c9c0a9c7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.730043] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-c0845e53-b126-43de-a3da-5356c9c0a9c7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.730342] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-c0845e53-b126-43de-a3da-5356c9c0a9c7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.730342] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0845e53-b126-43de-a3da-5356c9c0a9c7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.142463] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.233638] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.233914] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.234071] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.234413] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.234591] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.234790] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port c0845e53-b126-43de-a3da-5356c9c0a9c7 not found, creating... [ 1124.235187] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.235385] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.235695] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.236017] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.236201] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.236532] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.236705] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.236826] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.237069] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.237230] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.237413] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: c0845e53-b126-43de-a3da-5356c9c0a9c7 is going to be created. [ 1124.286927] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.287869] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.288010] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.288320] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.288557] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.288791] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-c0845e53-b126-43de-a3da-5356c9c0a9c7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.648636] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.648874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.648874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.649077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.649205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.649284] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1124.679861] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.680009] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.680064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.680238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.680385] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.690020] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1124.999305] env[65102]: INFO networking_nsxv3.common.synchronization [req-19646250-1c92-44e2-8bd8-40af895be976 req-0a1cf24f-f085-4b8b-a4e9-9789d0563482 service nova] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_rules [ 1124.999586] env[65102]: INFO networking_nsxv3.common.synchronization [req-19646250-1c92-44e2-8bd8-40af895be976 req-0a1cf24f-f085-4b8b-a4e9-9789d0563482 service nova] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1124.999718] env[65102]: INFO networking_nsxv3.common.synchronization [req-19646250-1c92-44e2-8bd8-40af895be976 req-0a1cf24f-f085-4b8b-a4e9-9789d0563482 service nova] Enqueued Resource ID: c0845e53-b126-43de-a3da-5356c9c0a9c7 with Priority: HIGHEST for action port [ 1125.000441] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_rules [ 1125.000618] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1125.000749] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0845e53-b126-43de-a3da-5356c9c0a9c7 with Priority: HIGHEST for action port [ 1125.001174] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.001832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.001913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.002204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.002305] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.003593] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.003710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.003927] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0845e53-b126-43de-a3da-5356c9c0a9c7 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.004043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0845e53-b126-43de-a3da-5356c9c0a9c7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.004110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0845e53-b126-43de-a3da-5356c9c0a9c7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.004294] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0845e53-b126-43de-a3da-5356c9c0a9c7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.006024] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0845e53-b126-43de-a3da-5356c9c0a9c7',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.508735] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0845e53-b126-43de-a3da-5356c9c0a9c7 with status ACTIVE [ 1125.508735] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.508735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.508735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.508735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.508735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.508735] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.508735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.508735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.508735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.508735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.508735] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.508735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.509633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.509633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.509633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.509633] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0845e53-b126-43de-a3da-5356c9c0a9c7 is going to be updated. [ 1125.515546] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.515546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.542462] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.542755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.542856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.543059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.543206] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.543365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0845e53-b126-43de-a3da-5356c9c0a9c7" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.743766] env[65102]: INFO networking_nsxv3.common.synchronization [req-7209d329-3fec-4c19-b350-dca0fe4e2b42 req-80042a2f-b5dd-49ec-ba43-4b3e085b8ffc tempest-ServerActionsTestOtherB-1046242315 tempest-ServerActionsTestOtherB-1046242315-project-member] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 1125.744585] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 1125.744707] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.745329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.745329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.745329] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.745566] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.745566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.745732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.745788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.745837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.746090] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.153722] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.153902] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.154043] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.155192] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.155192] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.155192] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.155192] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.155447] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.155608] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.155821] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.155991] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1126.156158] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1126.156302] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1126.156380] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.156483] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1126.156612] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1126.183409] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1126.183668] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1126.183758] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1126.183950] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.184444] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.184707] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.184886] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.185436] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.185660] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b5b909b-b28a-42bf-ad8f-3dd0e7df6811',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.249399] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.249695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.249801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.250060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.250183] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.250462] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.250590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.250649] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.250831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.250939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.251043] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be updated. [ 1126.281961] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.282193] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.282288] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.282566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.282732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.293759] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: IN_PROGRESS for 2s [ 1126.360692] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.361014] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.361239] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.361657] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.362112] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.362370] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.362587] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.362944] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.363247] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.363542] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.363740] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1126.363938] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1126.364145] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1126.364347] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.364531] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1126.364743] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1126.386543] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1126.386803] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1126.387064] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1126.387293] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.387744] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.388049] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.388243] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.388702] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.388904] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12711066-1ddb-4f73-aaf9-f2eb3d8c4515',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.688900] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.689344] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.689344] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.689709] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.689952] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.690223] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 not found, creating... [ 1126.690546] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.690742] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.690866] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.691132] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.691273] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.691569] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.691744] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.691864] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.692111] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.692253] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.692396] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 is going to be created. [ 1126.710233] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1126.710536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.710783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.711416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.711416] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.711763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.711763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.711763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.713086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.713086] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.724362] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.724592] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.724725] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.725086] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.725322] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.725633] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.891894] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.892143] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.892263] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.892550] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.892718] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.893042] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 12711066-1ddb-4f73-aaf9-f2eb3d8c4515 not found, creating... [ 1126.893404] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.893584] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.893704] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.893951] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.894108] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.894450] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.894622] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.894742] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.895047] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.895204] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.895351] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 12711066-1ddb-4f73-aaf9-f2eb3d8c4515 is going to be created. [ 1126.927759] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.928069] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.928147] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.928383] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.928619] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.928853] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.216035] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.636841] env[65102]: INFO networking_nsxv3.common.synchronization [req-c475317b-ce0f-4648-a57c-19a774abe746 req-3dd46398-37b4-4d78-8b00-188f60830d4d service nova] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_rules [ 1127.636841] env[65102]: INFO networking_nsxv3.common.synchronization [req-c475317b-ce0f-4648-a57c-19a774abe746 req-3dd46398-37b4-4d78-8b00-188f60830d4d service nova] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1127.636962] env[65102]: INFO networking_nsxv3.common.synchronization [req-c475317b-ce0f-4648-a57c-19a774abe746 req-3dd46398-37b4-4d78-8b00-188f60830d4d service nova] Enqueued Resource ID: 12711066-1ddb-4f73-aaf9-f2eb3d8c4515 with Priority: HIGHEST for action port [ 1127.637582] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_rules [ 1127.637724] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1127.637836] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12711066-1ddb-4f73-aaf9-f2eb3d8c4515 with Priority: HIGHEST for action port [ 1127.638152] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.638279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.638340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.638547] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.638628] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.639488] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.639604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.639671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.639839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.640081] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.640081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.640244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.640295] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.640362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.640482] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.641315] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.642173] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.642173] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.642173] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.642173] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12711066-1ddb-4f73-aaf9-f2eb3d8c4515',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.717853] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.908057] env[65102]: INFO networking_nsxv3.common.synchronization [req-7209d329-3fec-4c19-b350-dca0fe4e2b42 req-7798ad4a-f22a-4a1e-bfa8-0dbdfc49404a service nova] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_rules [ 1127.908255] env[65102]: INFO networking_nsxv3.common.synchronization [req-7209d329-3fec-4c19-b350-dca0fe4e2b42 req-7798ad4a-f22a-4a1e-bfa8-0dbdfc49404a service nova] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 1127.908391] env[65102]: INFO networking_nsxv3.common.synchronization [req-7209d329-3fec-4c19-b350-dca0fe4e2b42 req-7798ad4a-f22a-4a1e-bfa8-0dbdfc49404a service nova] Enqueued Resource ID: 4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 with Priority: HIGHEST for action port [ 1127.908955] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_rules [ 1127.909112] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 1127.909239] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 with Priority: HIGHEST for action port [ 1127.909519] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.909660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.909767] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.909950] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.910055] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.910938] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.911050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.911257] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.911359] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.911453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.911600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.911679] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b5b909b-b28a-42bf-ad8f-3dd0e7df6811',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.143225] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.143417] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.143561] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.147169] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12711066-1ddb-4f73-aaf9-f2eb3d8c4515 with status ACTIVE [ 1128.147169] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.147169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.147169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.147169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.147169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.147169] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.147675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.147675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.147675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.147675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.147675] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.147827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.147827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.148724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.148724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.148724] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12711066-1ddb-4f73-aaf9-f2eb3d8c4515 is going to be updated. [ 1128.175349] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.175539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.175586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.175791] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.176161] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.176400] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.221276] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.221276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.221276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.221535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.221535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.221640] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1128.240426] env[65102]: INFO networking_nsxv3.common.synchronization [req-2372d89c-4aed-4641-a280-efb3823f711e req-7214bdca-d3ad-4ffe-bcac-6256d59a050a tempest-ImagesOneServerNegativeTestJSON-1910886864 tempest-ImagesOneServerNegativeTestJSON-1910886864-project-member] Enqueued Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1128.241033] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1128.241368] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.241490] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.241577] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.241803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.241974] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.242096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.242156] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.242307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.242406] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.242504] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.258669] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.258806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.258941] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.259094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.259240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.284090] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1128.308075] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 1128.308305] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 deletion is rescheduled due to dependency. [ 1128.308454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.308673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.308980] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.309278] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.309449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.309541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.309741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.309835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.309989] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.413258] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.413512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.413564] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 with status ACTIVE [ 1128.413735] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.413843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.413910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.414169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.414263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.414439] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.414535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.414597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.414759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.414837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.415131] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.415230] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.415291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.415439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.415516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.415603] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 is going to be updated. [ 1128.438120] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.438322] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.438366] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.438553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.438704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.438865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.516982] env[65102]: INFO networking_nsxv3.common.synchronization [req-8b759a21-a8b1-4264-b5f7-af7f502e2562 req-a827ff89-6872-44ec-b221-24e258d93099 tempest-AttachVolumeShelveTestJSON-733143698 tempest-AttachVolumeShelveTestJSON-733143698-project-member] Enqueued Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_members [ 1128.517845] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_members [ 1128.517955] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0807565d-e6cc-4e93-b299-cd44c8892eaa taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.518055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.518121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.518364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.518527] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.518631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.518695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.518841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.518928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.519033] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.647678] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.745118] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.745520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.745520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.745591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.745665] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.746221] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.746416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.746494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.746684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.747186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.747343] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c is going to be updated. [ 1128.785220] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.786275] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.786425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.786791] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.786956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.801087] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: IN_PROGRESS for 2s [ 1128.813622] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.882873] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-500 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.883170] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.883269] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.883538] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.883950] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.884119] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.884265] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.884542] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.884740] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.884934] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1128.885079] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1128.885205] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1128.885319] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1128.885425] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1128.885531] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1128.885666] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1128.905594] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1128.905828] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1128.905930] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1128.906098] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.906501] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.906686] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.907351] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.907807] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.908033] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72f482ac-0a93-4cf4-9d54-a7e812ca4cd9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.023049] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.023049] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.023049] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.023049] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.023049] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.023049] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.023416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.023416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.023416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.023515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.023543] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa already deleted. [ 1129.023611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.149871] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.149871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.149871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.150135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.150842] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.152098] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1129.202196] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.202480] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.202593] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.202917] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.203128] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.229984] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1129.316323] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.411448] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.411712] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.411712] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.412219] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.412433] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.412629] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 not found, creating... [ 1129.412964] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.413180] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.413300] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.413548] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.413691] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.414084] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.414342] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.414519] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.414897] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.415119] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.415362] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 is going to be created. [ 1129.441629] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.441924] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.442011] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.442254] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.442484] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.442723] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.819519] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.819953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.819953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.820296] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.820494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.820670] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be updated. [ 1129.857427] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.857593] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.857669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.857910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.858091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.868369] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: IN_PROGRESS for 2s [ 1130.215489] env[65102]: INFO networking_nsxv3.common.synchronization [req-8b759a21-a8b1-4264-b5f7-af7f502e2562 req-d39d37af-66c0-4c4b-a5d4-82b16513e555 service nova] Enqueued Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_rules [ 1130.215696] env[65102]: INFO networking_nsxv3.common.synchronization [req-8b759a21-a8b1-4264-b5f7-af7f502e2562 req-d39d37af-66c0-4c4b-a5d4-82b16513e555 service nova] Enqueued Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_members [ 1130.215853] env[65102]: INFO networking_nsxv3.common.synchronization [req-8b759a21-a8b1-4264-b5f7-af7f502e2562 req-d39d37af-66c0-4c4b-a5d4-82b16513e555 service nova] Enqueued Resource ID: 72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 with Priority: HIGHEST for action port [ 1130.216430] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_rules [ 1130.218034] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_members [ 1130.218163] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 with Priority: HIGHEST for action port [ 1130.218472] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0807565d-e6cc-4e93-b299-cd44c8892eaa taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.218601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.218672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.218879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.218965] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.219880] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0807565d-e6cc-4e93-b299-cd44c8892eaa taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.220023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.220072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.220295] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.220392] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.220486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.220545] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.220685] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.220767] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.220859] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.227021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.227021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.227021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.227021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.227021] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72f482ac-0a93-4cf4-9d54-a7e812ca4cd9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.296039] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1130.296272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.296447] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.296666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.296904] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.296977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.297068] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.297208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.297297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.297424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.297560] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.431774] env[65102]: INFO networking_nsxv3.common.synchronization [None req-27cbd475-544a-4a8d-a927-17cfcdc4e56b None None] Enqueued Resource ID: eec1231d-815e-4ea9-9fd5-5efe4be1b6cd with Priority: HIGHEST for action port [ 1130.432412] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eec1231d-815e-4ea9-9fd5-5efe4be1b6cd with Priority: HIGHEST for action port [ 1130.432911] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-eec1231d-815e-4ea9-9fd5-5efe4be1b6cd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.433096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eec1231d-815e-4ea9-9fd5-5efe4be1b6cd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.433208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eec1231d-815e-4ea9-9fd5-5efe4be1b6cd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.433473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eec1231d-815e-4ea9-9fd5-5efe4be1b6cd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.433521] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eec1231d-815e-4ea9-9fd5-5efe4be1b6cd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.726688] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0807565d-e6cc-4e93-b299-cd44c8892eaa taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.726824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.727042] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.729190] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 with status ACTIVE [ 1130.729402] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.729526] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.730150] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.730150] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.730150] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.730314] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.730314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.730400] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.730522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.730602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.730784] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.730873] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.730929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.731080] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.731157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.731334] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 is going to be updated. [ 1130.756854] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.756995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.757144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.757331] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.757476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.757637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.801371] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.801371] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.801371] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.801371] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.801371] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.801371] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.801650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.801650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.801713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.801770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.801951] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.802055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.802114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.802296] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.802444] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.802534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.802591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.802816] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.802991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.803109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.803206] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.816231] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: SUCCESS [ 1130.816407] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c deletion is rescheduled due to dependency. [ 1130.816521] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.937483] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eec1231d-815e-4ea9-9fd5-5efe4be1b6cd [ 1130.937812] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.937812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.937924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.938184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.938278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.938536] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eec1231d-815e-4ea9-9fd5-5efe4be1b6cd already deleted. [ 1130.938650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eec1231d-815e-4ea9-9fd5-5efe4be1b6cd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.229630] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.244764] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1131.244764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.244764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.244764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.244764] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.244764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.244764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.245132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.245132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.245132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.245132] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.307025] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8746f52-1411-469d-8df9-8b15536649f6: rpc.has_security_group_logging(os_id): False [ 1131.329290] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.329725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.329725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.329725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.329834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.330014] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.330164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.330221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.330353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.330435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.330631] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.330725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.330794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.330977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.331039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.331237] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.331602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.331602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.331602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.331708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.331735] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1131.414784] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.414784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.414784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.415087] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.417024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.438173] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1131.734888] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.734888] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.735035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.735286] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.735409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.735542] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa is going to be created. [ 1131.747915] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.748188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.748330] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.748619] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.748851] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.749082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.749198] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.749421] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.749516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.749610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.749772] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.749924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.749924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.750090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.750240] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.750338] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.750388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.750520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.750598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.750679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.750772] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.770714] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.770714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.770714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.770714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.770714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.836688] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa in Status: UNINITIALIZED for 2s [ 1131.879400] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 1131.879700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.879804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.880040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.880242] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.880510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.880510] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.880599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.880644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.880737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.880832] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.253715] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59c26ae1-e2ae-453d-a285-e702cf89832f: rpc.has_security_group_logging(os_id): False [ 1132.306849] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.307395] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.307513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.307808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.307946] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.308261] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.308388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.308488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.309204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.309204] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.309441] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.309601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.309676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.309846] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.310073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.310216] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.310357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.310427] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.310630] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.311716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.312263] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1132.383062] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.439864] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.440058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.440165] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.440548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.440730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.458915] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1132.507059] env[65102]: INFO networking_nsxv3.common.synchronization [req-08c23b09-5053-4741-aab1-0adbc65900ac req-d9b59b8f-a651-4d81-99b0-7677ac35afa2 tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: 43c26daa-d251-465e-af14-279e7838d2a3 with Priority: HIGHEST for action security_group_members [ 1132.508214] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c26daa-d251-465e-af14-279e7838d2a3 with Priority: HIGHEST for action security_group_members [ 1132.508584] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c26daa-d251-465e-af14-279e7838d2a3 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.508798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.508798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.510189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.510189] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.510189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.510189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.510189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.510189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.510189] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c26daa-d251-465e-af14-279e7838d2a3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.887121] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0212d5d1-3785-49e1-b4e8-aaad4f538d18: rpc.has_security_group_logging(os_id): False [ 1132.907540] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.907833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.907833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.908278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.908278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.908629] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.908629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.908629] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.909154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.909154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.909154] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be updated. [ 1132.927328] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.927430] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.927582] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.927840] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.928951] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.929147] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.929274] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.929625] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.929795] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.930101] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1132.932821] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.932821] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.932821] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.932821] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1132.932821] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.932821] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.955852] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.956055] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1132.956164] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.956419] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-232" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.956677] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-3914e94e-1c0c-410a-adcb-0ac7cb7ff3be taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.957170] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-3914e94e-1c0c-410a-adcb-0ac7cb7ff3be" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.957170] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-3914e94e-1c0c-410a-adcb-0ac7cb7ff3be" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.957522] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-3914e94e-1c0c-410a-adcb-0ac7cb7ff3be" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.959053] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3914e94e-1c0c-410a-adcb-0ac7cb7ff3be',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.993082] env[65102]: INFO networking_nsxv3.common.synchronization [None req-cc1fd74c-fc07-42f4-99e7-4fcece17d2ed None None] Enqueued Resource ID: df2cab86-9710-481a-8aed-fd487c165553 with Priority: HIGHEST for action port [ 1132.993684] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2cab86-9710-481a-8aed-fd487c165553 with Priority: HIGHEST for action port [ 1132.994383] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-df2cab86-9710-481a-8aed-fd487c165553 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.994477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df2cab86-9710-481a-8aed-fd487c165553" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.994477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df2cab86-9710-481a-8aed-fd487c165553" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.994741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df2cab86-9710-481a-8aed-fd487c165553" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.994903] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df2cab86-9710-481a-8aed-fd487c165553',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.997571] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.997679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.997726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.998078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.998244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.012947] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.012947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.012947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.013277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.013315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.013890] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.013890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.013890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.013890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.013890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.014189] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c26daa-d251-465e-af14-279e7838d2a3 already deleted. [ 1133.014189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.018272] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: IN_PROGRESS for 2s [ 1133.462439] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.462439] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.462439] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.462439] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.462882] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.462882] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 3914e94e-1c0c-410a-adcb-0ac7cb7ff3be not found, creating... [ 1133.463015] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.463207] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.463324] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.463573] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.463709] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.464027] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.464188] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.464302] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.464506] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.464637] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.464778] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 3914e94e-1c0c-410a-adcb-0ac7cb7ff3be is going to be created. [ 1133.468029] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1133.468280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.503443] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df2cab86-9710-481a-8aed-fd487c165553 [ 1133.503694] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.503833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.503904] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.504150] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.504970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.504970] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df2cab86-9710-481a-8aed-fd487c165553 already deleted. [ 1133.504970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df2cab86-9710-481a-8aed-fd487c165553" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.509091] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.509557] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.509557] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.509690] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.509927] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.510152] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-3914e94e-1c0c-410a-adcb-0ac7cb7ff3be" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.846700] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa in Status: SUCCESS [ 1133.846952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.847165] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.847431] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.847626] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.847747] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.847814] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.848162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.848162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.848162] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.848303] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.073170] env[65102]: INFO networking_nsxv3.common.synchronization [req-4a5ed9e9-f0c8-4835-b312-878be3ea6790 req-03cb9256-7e86-4a5b-95c0-2bcfe17fb51d tempest-ServerRescueNegativeTestJSON-286642771 tempest-ServerRescueNegativeTestJSON-286642771-project-member] Enqueued Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_members [ 1134.073726] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e683108f-84a0-4d62-934c-58f2999656a4 with Priority: HIGHEST for action security_group_members [ 1134.074097] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e683108f-84a0-4d62-934c-58f2999656a4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.074311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.074385] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.074587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.074747] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.074882] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.074952] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.075107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.075191] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.075286] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e683108f-84a0-4d62-934c-58f2999656a4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.221069] env[65102]: INFO networking_nsxv3.common.synchronization [req-08c23b09-5053-4741-aab1-0adbc65900ac req-66162222-5b92-4efa-9024-f67e5821ffe5 service nova] Enqueued Resource ID: 43c26daa-d251-465e-af14-279e7838d2a3 with Priority: HIGHEST for action security_group_rules [ 1134.221069] env[65102]: INFO networking_nsxv3.common.synchronization [req-08c23b09-5053-4741-aab1-0adbc65900ac req-66162222-5b92-4efa-9024-f67e5821ffe5 service nova] Enqueued Resource ID: 43c26daa-d251-465e-af14-279e7838d2a3 with Priority: HIGHEST for action security_group_members [ 1134.221069] env[65102]: INFO networking_nsxv3.common.synchronization [req-08c23b09-5053-4741-aab1-0adbc65900ac req-66162222-5b92-4efa-9024-f67e5821ffe5 service nova] Enqueued Resource ID: 3914e94e-1c0c-410a-adcb-0ac7cb7ff3be with Priority: HIGHEST for action port [ 1134.221069] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c26daa-d251-465e-af14-279e7838d2a3 with Priority: HIGHEST for action security_group_rules [ 1134.221069] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c26daa-d251-465e-af14-279e7838d2a3 with Priority: HIGHEST for action security_group_members [ 1134.221069] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3914e94e-1c0c-410a-adcb-0ac7cb7ff3be with Priority: HIGHEST for action port [ 1134.223923] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43c26daa-d251-465e-af14-279e7838d2a3 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.223923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.223923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.223923] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.223923] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43c26daa-d251-465e-af14-279e7838d2a3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.225391] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c26daa-d251-465e-af14-279e7838d2a3 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.225391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.225391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.225666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.225720] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.226461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.226461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.226461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.226461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.226461] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c26daa-d251-465e-af14-279e7838d2a3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.227787] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-3914e94e-1c0c-410a-adcb-0ac7cb7ff3be taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.227787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3914e94e-1c0c-410a-adcb-0ac7cb7ff3be" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.227787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3914e94e-1c0c-410a-adcb-0ac7cb7ff3be" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.227986] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3914e94e-1c0c-410a-adcb-0ac7cb7ff3be" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.229147] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3914e94e-1c0c-410a-adcb-0ac7cb7ff3be',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.350895] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.352537] env[65102]: INFO networking_nsxv3.common.synchronization [req-185b1a22-d0e4-4dcf-aac5-a4f7e52998df req-451fc80c-b67b-4911-90d8-ed1570981b74 tempest-ServerRescueTestJSON-675599107 tempest-ServerRescueTestJSON-675599107-project-member] Enqueued Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_members [ 1134.353738] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_members [ 1134.355146] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.355883] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.356047] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.356355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.356596] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.356908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.356908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.357252] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.357466] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.357669] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.476286] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1134.476662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.578126] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.578320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.578358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.578649] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.603123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.603123] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.603123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.603123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.603759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.603759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.603759] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e683108f-84a0-4d62-934c-58f2999656a4 is going to be updated. [ 1134.636648] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.636785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.636849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.637167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.637304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.647451] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e683108f-84a0-4d62-934c-58f2999656a4 in Status: IN_PROGRESS for 2s [ 1134.730834] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43c26daa-d251-465e-af14-279e7838d2a3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.732442] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c26daa-d251-465e-af14-279e7838d2a3 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.732627] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.734671] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3914e94e-1c0c-410a-adcb-0ac7cb7ff3be with status ACTIVE [ 1134.734671] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.734671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.734671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.734671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.734671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.734671] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.734671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.734671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.734671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.734671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.734671] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.734671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.734671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.734671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.734671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.734671] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3914e94e-1c0c-410a-adcb-0ac7cb7ff3be is going to be updated. [ 1134.775937] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.776143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.776143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.776898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.776898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.776898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3914e94e-1c0c-410a-adcb-0ac7cb7ff3be" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.855687] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0807565d-e6cc-4e93-b299-cd44c8892eaa: rpc.has_security_group_logging(os_id): False [ 1134.862063] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.879464] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.880293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.880293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.880293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.880293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.880511] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.880511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.880511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.880764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.880798] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.881514] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa is going to be created. [ 1135.000197] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.000393] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.000439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.000624] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.000806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.026206] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa in Status: IN_PROGRESS for 2s [ 1135.037324] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 1135.037541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.237374] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43c26daa-d251-465e-af14-279e7838d2a3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.365127] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.739839] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.742658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.742658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.742658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.742658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.742658] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c26daa-d251-465e-af14-279e7838d2a3 is going to be created. [ 1135.766856] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.767272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.767478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.767799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.768707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.779237] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c26daa-d251-465e-af14-279e7838d2a3 in Status: UNINITIALIZED for 2s [ 1135.868351] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.868470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.868511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.869094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.869094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.869094] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d17fda10-7148-4558-b429-6c6b75b5f20d is going to be updated. [ 1135.926832] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.927164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.927311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.927618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.927878] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.968966] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d17fda10-7148-4558-b429-6c6b75b5f20d in Status: IN_PROGRESS for 2s [ 1136.657605] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e683108f-84a0-4d62-934c-58f2999656a4 in Status: SUCCESS [ 1136.657777] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e683108f-84a0-4d62-934c-58f2999656a4 deletion is rescheduled due to dependency. [ 1136.657894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e683108f-84a0-4d62-934c-58f2999656a4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.040651] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa in Status: SUCCESS [ 1137.041067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.354544] env[65102]: INFO networking_nsxv3.common.synchronization [None req-28088740-e439-49b0-ae7b-435eca0d66dc tempest-ImagesOneServerNegativeTestJSON-1910886864 tempest-ImagesOneServerNegativeTestJSON-1910886864-project-member] Enqueued Resource ID: a318aa09-f25e-42a0-95a5-2247490dae35 with Priority: HIGHEST for action security_group_rules [ 1137.355186] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a318aa09-f25e-42a0-95a5-2247490dae35 with Priority: HIGHEST for action security_group_rules [ 1137.355495] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a318aa09-f25e-42a0-95a5-2247490dae35 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.355616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a318aa09-f25e-42a0-95a5-2247490dae35" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.355684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a318aa09-f25e-42a0-95a5-2247490dae35" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.355996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a318aa09-f25e-42a0-95a5-2247490dae35" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.356096] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a318aa09-f25e-42a0-95a5-2247490dae35',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.436021] env[65102]: INFO networking_nsxv3.common.synchronization [None req-637ea9dc-8012-4d15-8d42-a09408d108f4 tempest-ImagesOneServerNegativeTestJSON-1910886864 tempest-ImagesOneServerNegativeTestJSON-1910886864-project-member] Enqueued Resource ID: a318aa09-f25e-42a0-95a5-2247490dae35 with Priority: HIGHEST for action security_group_rules [ 1137.436021] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a318aa09-f25e-42a0-95a5-2247490dae35 with Priority: HIGHEST for action security_group_rules [ 1137.436021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a318aa09-f25e-42a0-95a5-2247490dae35 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.436256] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a318aa09-f25e-42a0-95a5-2247490dae35" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.790922] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c26daa-d251-465e-af14-279e7838d2a3 in Status: SUCCESS [ 1137.791860] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.791860] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.791860] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.792111] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.792257] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.792409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.792502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.792605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.792724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.792838] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43c26daa-d251-465e-af14-279e7838d2a3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.880366] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.880512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.880512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.881063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.881063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.881063] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a318aa09-f25e-42a0-95a5-2247490dae35 already deleted. [ 1137.881063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a318aa09-f25e-42a0-95a5-2247490dae35" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.881260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a318aa09-f25e-42a0-95a5-2247490dae35" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.881838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a318aa09-f25e-42a0-95a5-2247490dae35" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.881838] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a318aa09-f25e-42a0-95a5-2247490dae35',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.981719] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d17fda10-7148-4558-b429-6c6b75b5f20d in Status: SUCCESS [ 1137.982837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.296288] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43c26daa-d251-465e-af14-279e7838d2a3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.404044] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.404044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.404044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.404044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.404044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.404044] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a318aa09-f25e-42a0-95a5-2247490dae35 already deleted. [ 1138.404370] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a318aa09-f25e-42a0-95a5-2247490dae35" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.797832] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43c26daa-d251-465e-af14-279e7838d2a3: rpc.has_security_group_logging(os_id): False [ 1138.823546] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.823777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.823825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.824501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.824501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.824501] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.824712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.824712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.824900] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.824980] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.825080] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43c26daa-d251-465e-af14-279e7838d2a3 is going to be created. [ 1138.888290] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.888736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.888958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.889372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.889797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.902189] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c26daa-d251-465e-af14-279e7838d2a3 in Status: IN_PROGRESS for 2s [ 1139.469424] env[65102]: INFO networking_nsxv3.common.synchronization [req-b2a82482-6a87-4f33-a630-c5bbb697fff4 req-9865b542-3461-4d74-bf83-32bf99caa656 tempest-ServerDiskConfigTestJSON-1771527805 tempest-ServerDiskConfigTestJSON-1771527805-project-member] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1139.469736] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1139.470536] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.470706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.470781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.470992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.471455] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.471592] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.471659] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.471827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.471917] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.472026] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.975285] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.975433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.975696] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.975783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.975835] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.976438] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.976635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.976717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.977085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.977448] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.977448] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 1139.987296] env[65102]: INFO networking_nsxv3.common.synchronization [req-31d4e266-3484-470a-a18d-916db35fb171 req-c7b0f335-a13a-4ab4-979e-ae94acbab0bc tempest-ServersNegativeTestJSON-56640959 tempest-ServersNegativeTestJSON-56640959-project-member] Enqueued Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_members [ 1139.987844] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_members [ 1139.988163] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.988348] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.988348] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.989164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.989164] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.989164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.989164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.989164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.989440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.989440] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.006690] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.006841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.006912] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.007143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.007303] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.016521] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 1140.372534] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-198 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.372534] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-198" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.372779] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-198" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.373915] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-198" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.373915] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.373915] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.373915] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.373915] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.373915] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.374333] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.374333] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.374333] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.374333] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.374513] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.374560] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.375331] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.395664] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.395839] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1140.395979] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.396188] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-198" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.396642] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-e48b19c2-6253-4a9c-a6fb-1daae3460ede taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.396827] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.396949] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.397293] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.397436] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e48b19c2-6253-4a9c-a6fb-1daae3460ede',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.493633] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.493942] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.494116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.494389] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.494477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.494898] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.495037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.495284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.495463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.495546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.495649] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 already deleted. [ 1140.495754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.900567] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.900927] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.901161] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.901581] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.901791] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.902061] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port e48b19c2-6253-4a9c-a6fb-1daae3460ede not found, creating... [ 1140.902551] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.902834] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.903048] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.903405] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.903639] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.904134] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.904399] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.904592] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.904978] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.905226] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.905404] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: e48b19c2-6253-4a9c-a6fb-1daae3460ede is going to be created. [ 1140.921851] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c26daa-d251-465e-af14-279e7838d2a3 in Status: SUCCESS [ 1140.922190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.930615] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.930910] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.931033] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.931354] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.931713] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.931996] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.645449] env[65102]: INFO networking_nsxv3.common.synchronization [req-31d4e266-3484-470a-a18d-916db35fb171 req-ba4392e4-7298-4728-86c4-65e3c3e19a9f service nova] Enqueued Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_rules [ 1141.645700] env[65102]: INFO networking_nsxv3.common.synchronization [req-31d4e266-3484-470a-a18d-916db35fb171 req-ba4392e4-7298-4728-86c4-65e3c3e19a9f service nova] Enqueued Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_members [ 1141.645754] env[65102]: INFO networking_nsxv3.common.synchronization [req-31d4e266-3484-470a-a18d-916db35fb171 req-ba4392e4-7298-4728-86c4-65e3c3e19a9f service nova] Enqueued Resource ID: e48b19c2-6253-4a9c-a6fb-1daae3460ede with Priority: HIGHEST for action port [ 1141.646350] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_rules [ 1141.646492] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_members [ 1141.646592] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e48b19c2-6253-4a9c-a6fb-1daae3460ede with Priority: HIGHEST for action port [ 1141.646897] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.647804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.648639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.648639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.648719] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.650614] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.651200] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.651200] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.651200] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.651341] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.651414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.651589] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.651825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.652065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.652065] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.653260] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-e48b19c2-6253-4a9c-a6fb-1daae3460ede taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.653678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.653815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.654048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.654188] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e48b19c2-6253-4a9c-a6fb-1daae3460ede',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.028792] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 1142.028792] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f deletion is rescheduled due to dependency. [ 1142.028792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.158439] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.158439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.158439] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.158439] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e48b19c2-6253-4a9c-a6fb-1daae3460ede with status ACTIVE [ 1142.158439] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.158439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.158439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.158439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.158439] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.158871] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.158871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.158871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.158966] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.159020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.159181] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.159293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.159331] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.160746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.160746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.160746] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e48b19c2-6253-4a9c-a6fb-1daae3460ede is going to be updated. [ 1142.188437] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.188437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.188437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.188437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.188437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.188774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.663038] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.166238] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.166419] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.166493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.166737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.166866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.167068] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 is going to be created. [ 1143.236654] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.236654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.236654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.236654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.236654] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.249958] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: UNINITIALIZED for 2s [ 1145.262790] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: SUCCESS [ 1145.263125] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.263248] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.263534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.263673] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.263837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.263837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.263995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.264150] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.264197] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.264265] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.767053] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.767580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.767701] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.767972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.769072] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.769235] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.769312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.769494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.769584] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.769674] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.769835] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.769991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.769991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.770151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.770291] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.770381] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.770441] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.770576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.770651] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.770734] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.770824] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.274424] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e9c3133-b79e-4eb2-8ba0-d484113ac747: rpc.has_security_group_logging(os_id): False [ 1146.297191] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.297877] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.297990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.298332] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.298505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.298831] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.299019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.299131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.299404] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.299548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.300206] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.300383] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.300498] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.301112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.303648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.303648] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.303648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.303648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.303648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.303648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.303648] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 is going to be created. [ 1146.313157] env[65102]: INFO networking_nsxv3.common.synchronization [None req-da1e13a9-1e33-4ca6-adb6-7894ee2086c4 None None] Enqueued Resource ID: 71129562-01fd-418d-8d50-c9fe0bac1d7e with Priority: HIGHEST for action port [ 1146.313731] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71129562-01fd-418d-8d50-c9fe0bac1d7e with Priority: HIGHEST for action port [ 1146.314326] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-71129562-01fd-418d-8d50-c9fe0bac1d7e taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.314475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71129562-01fd-418d-8d50-c9fe0bac1d7e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.314542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71129562-01fd-418d-8d50-c9fe0bac1d7e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.314869] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71129562-01fd-418d-8d50-c9fe0bac1d7e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.315050] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71129562-01fd-418d-8d50-c9fe0bac1d7e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.384504] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.384859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.384935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.385841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.385841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.404496] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: IN_PROGRESS for 2s [ 1146.646885] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb2b3114-2296-4c24-b045-d52b1c98c066 req-4bf51be9-952f-4eb4-be0f-28e2d802522d tempest-ServerDiskConfigTestJSON-1771527805 tempest-ServerDiskConfigTestJSON-1771527805-project-member] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1146.647479] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1146.647789] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.647914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.647981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.650926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.650926] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.650926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.650926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.650926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.650926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.650926] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.819732] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71129562-01fd-418d-8d50-c9fe0bac1d7e [ 1146.819732] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.819732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.819732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.819732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.819732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.819732] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71129562-01fd-418d-8d50-c9fe0bac1d7e already deleted. [ 1146.819732] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71129562-01fd-418d-8d50-c9fe0bac1d7e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.907837] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.908058] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.908184] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.908446] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.908706] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.908864] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.909015] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.909848] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.910086] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.911049] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.911219] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.911352] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.911467] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.911581] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.911698] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.911849] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.932147] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.932375] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1146.933109] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.933109] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-211" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.933109] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.933309] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.933449] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.933692] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.933857] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12711066-1ddb-4f73-aaf9-f2eb3d8c4515',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.008168] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-312 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.008381] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.008507] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.008765] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.009023] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.009176] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.009292] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.009504] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.009646] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.009908] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.010018] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.010124] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.010233] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.010349] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.010440] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.010568] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.030078] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.030255] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1147.030391] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.030580] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-312" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.030893] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-3e149eec-773a-449a-8c36-4dd31d98e502 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.031075] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-3e149eec-773a-449a-8c36-4dd31d98e502" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.031195] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-3e149eec-773a-449a-8c36-4dd31d98e502" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.031515] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-3e149eec-773a-449a-8c36-4dd31d98e502" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.031653] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e149eec-773a-449a-8c36-4dd31d98e502',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.153675] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.153675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.153675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.153675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.153675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.153989] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.153989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.154090] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.154247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.154314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.154407] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 1147.180590] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.180804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.180804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.181017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.181169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.191894] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 1147.436318] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.436846] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.436846] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.437037] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.437230] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.437541] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.437726] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.437910] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.438188] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.438363] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.438721] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.438889] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.439039] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.439240] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.439378] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.439524] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 12711066-1ddb-4f73-aaf9-f2eb3d8c4515 is going to be updated. [ 1147.464948] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.465435] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.465435] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.465620] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.465832] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.466084] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.533869] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.534141] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.534308] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.534673] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.534878] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.535109] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 3e149eec-773a-449a-8c36-4dd31d98e502 not found, creating... [ 1147.535416] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.535627] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.535773] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.536061] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.536233] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.536594] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.536817] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.536987] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.537277] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.537442] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.537641] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 3e149eec-773a-449a-8c36-4dd31d98e502 is going to be created. [ 1147.600876] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.600876] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.600876] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.600876] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.600876] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.600876] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-3e149eec-773a-449a-8c36-4dd31d98e502" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.307402] env[65102]: INFO networking_nsxv3.common.synchronization [None req-87c947c8-a798-4a6c-b074-bc4fe49e1679 None None] Enqueued Resource ID: 9848a0c6-7d00-4551-92bf-8c5f24176d5b with Priority: HIGHEST for action port [ 1148.308028] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9848a0c6-7d00-4551-92bf-8c5f24176d5b with Priority: HIGHEST for action port [ 1148.308576] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-9848a0c6-7d00-4551-92bf-8c5f24176d5b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.308576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9848a0c6-7d00-4551-92bf-8c5f24176d5b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.308576] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9848a0c6-7d00-4551-92bf-8c5f24176d5b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.308795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9848a0c6-7d00-4551-92bf-8c5f24176d5b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.308875] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9848a0c6-7d00-4551-92bf-8c5f24176d5b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.323980] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb2b3114-2296-4c24-b045-d52b1c98c066 req-0314fe7b-920a-47cb-a0f0-aef21f837a96 service nova] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_rules [ 1148.323980] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb2b3114-2296-4c24-b045-d52b1c98c066 req-0314fe7b-920a-47cb-a0f0-aef21f837a96 service nova] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1148.323980] env[65102]: INFO networking_nsxv3.common.synchronization [req-fb2b3114-2296-4c24-b045-d52b1c98c066 req-0314fe7b-920a-47cb-a0f0-aef21f837a96 service nova] Enqueued Resource ID: 3e149eec-773a-449a-8c36-4dd31d98e502 with Priority: HIGHEST for action port [ 1148.325691] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_rules [ 1148.326903] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1148.327219] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e149eec-773a-449a-8c36-4dd31d98e502 with Priority: HIGHEST for action port [ 1148.328135] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.328135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.328135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.328135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.328135] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.329170] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.330137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.330137] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e149eec-773a-449a-8c36-4dd31d98e502 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.330137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e149eec-773a-449a-8c36-4dd31d98e502" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.330137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e149eec-773a-449a-8c36-4dd31d98e502" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.330137] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e149eec-773a-449a-8c36-4dd31d98e502" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.330137] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e149eec-773a-449a-8c36-4dd31d98e502',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.420514] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: SUCCESS [ 1148.420514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.622273] env[65102]: INFO networking_nsxv3.common.synchronization [req-8a2c6877-c893-4a37-8ed9-2e4fa11be147 req-9de582a6-563c-484d-bd2f-be8f822561c4 service nova] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_rules [ 1148.622273] env[65102]: INFO networking_nsxv3.common.synchronization [req-8a2c6877-c893-4a37-8ed9-2e4fa11be147 req-9de582a6-563c-484d-bd2f-be8f822561c4 service nova] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1148.622273] env[65102]: INFO networking_nsxv3.common.synchronization [req-8a2c6877-c893-4a37-8ed9-2e4fa11be147 req-9de582a6-563c-484d-bd2f-be8f822561c4 service nova] Enqueued Resource ID: 12711066-1ddb-4f73-aaf9-f2eb3d8c4515 with Priority: HIGHEST for action port [ 1148.622273] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_rules [ 1148.622273] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1148.622273] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12711066-1ddb-4f73-aaf9-f2eb3d8c4515 with Priority: HIGHEST for action port [ 1148.622273] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.622273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.622273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.622273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.622273] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.626144] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.626144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.627270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.627270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.628022] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.628479] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.629745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.629745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.629745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.629745] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.633922] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.633922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.633922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.633922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.633922] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12711066-1ddb-4f73-aaf9-f2eb3d8c4515',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.655373] env[65102]: INFO networking_nsxv3.common.synchronization [req-6f5604ad-694c-4cfa-9983-a91d33dd9911 req-5df7ed39-4fdb-445b-9a75-346cfb407b55 tempest-ServerRescueTestJSON-675599107 tempest-ServerRescueTestJSON-675599107-project-member] Enqueued Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_members [ 1148.656192] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGHEST for action security_group_members [ 1148.656564] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.656721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.656804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.657485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.657485] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.657485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.657485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.657647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.657737] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.660050] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.825387] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9848a0c6-7d00-4551-92bf-8c5f24176d5b [ 1148.825533] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.825678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.825766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.826016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.826127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.826235] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9848a0c6-7d00-4551-92bf-8c5f24176d5b already deleted. [ 1148.826365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9848a0c6-7d00-4551-92bf-8c5f24176d5b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.833080] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.833258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.833560] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e149eec-773a-449a-8c36-4dd31d98e502 with status ACTIVE [ 1148.833794] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.833975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.834069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.834379] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.834478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.834895] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.835066] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.835066] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.835214] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.835294] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.835636] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.835796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.835916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.836052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.836115] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.836190] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e149eec-773a-449a-8c36-4dd31d98e502 is going to be updated. [ 1148.860187] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.860187] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.860187] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.860443] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.860636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.860818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e149eec-773a-449a-8c36-4dd31d98e502" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.866015] env[65102]: INFO networking_nsxv3.common.synchronization [None req-1394ac53-7b45-488a-adca-fad93e1b67fd tempest-AttachVolumeTestJSON-843685348 tempest-AttachVolumeTestJSON-843685348-project-member] Enqueued Resource ID: 29e1de56-440c-4328-94fb-d8f682a71bad with Priority: HIGHEST for action security_group_rules [ 1148.866337] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29e1de56-440c-4328-94fb-d8f682a71bad with Priority: HIGHEST for action security_group_rules [ 1148.867736] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29e1de56-440c-4328-94fb-d8f682a71bad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.867736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.867736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.867736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.867736] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29e1de56-440c-4328-94fb-d8f682a71bad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.015438] env[65102]: INFO networking_nsxv3.common.synchronization [req-c8729e8a-70cd-46a4-a55a-1b8cba57370d req-f6fae598-c660-42e5-9010-33c6671c006e tempest-ImagesOneServerNegativeTestJSON-1910886864 tempest-ImagesOneServerNegativeTestJSON-1910886864-project-member] Enqueued Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1149.016111] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1149.016449] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.017328] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.018349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.018665] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.018946] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.019262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.019262] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.019493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.019558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.020338] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.046050] env[65102]: INFO networking_nsxv3.common.synchronization [None req-f20a3e1a-ca78-4d09-b64e-737fe300c13d tempest-AttachVolumeTestJSON-843685348 tempest-AttachVolumeTestJSON-843685348-project-member] Enqueued Resource ID: 29e1de56-440c-4328-94fb-d8f682a71bad with Priority: HIGHEST for action security_group_rules [ 1149.046568] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29e1de56-440c-4328-94fb-d8f682a71bad with Priority: HIGHEST for action security_group_rules [ 1149.046887] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29e1de56-440c-4328-94fb-d8f682a71bad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.047019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.134324] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.135665] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.135792] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.135964] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12711066-1ddb-4f73-aaf9-f2eb3d8c4515 with status ACTIVE [ 1149.139020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.139020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.139020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.139020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.139020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.139020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.139020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.139020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.139020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.139020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.139020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.139020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.139020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.139020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.139020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.139020] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12711066-1ddb-4f73-aaf9-f2eb3d8c4515 is going to be updated. [ 1149.164558] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.164723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.164837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.165189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.165189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.165331] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12711066-1ddb-4f73-aaf9-f2eb3d8c4515" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.165588] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.165756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.165756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.165974] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.166038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.166161] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.166287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.166337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.166741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.166741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.166741] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d17fda10-7148-4558-b429-6c6b75b5f20d is going to be updated. [ 1149.199868] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.199868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.199868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.200316] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.200316] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.213635] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 1149.214303] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f deletion is rescheduled due to dependency. [ 1149.214303] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.217096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.217096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.217408] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.220019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.220019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.220019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.220019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.220019] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.220459] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d17fda10-7148-4558-b429-6c6b75b5f20d in Status: IN_PROGRESS for 2s [ 1149.388773] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.389013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.389013] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.390025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.390025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.390025] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29e1de56-440c-4328-94fb-d8f682a71bad already deleted. [ 1149.390025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.390025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.390025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.390025] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29e1de56-440c-4328-94fb-d8f682a71bad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.433970] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.434503] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-844" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.435313] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-844" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.435313] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-844" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.435864] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.438881] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.438881] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.438881] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.438881] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.438881] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1149.438881] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1149.438881] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1149.438881] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1149.438881] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1149.438881] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1149.438881] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1149.464099] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1149.464282] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1149.464336] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1149.464514] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-844" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.464916] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-079f6503-3319-4d8a-b94b-843464a762f0 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.465119] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-079f6503-3319-4d8a-b94b-843464a762f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.465241] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-079f6503-3319-4d8a-b94b-843464a762f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.465587] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-079f6503-3319-4d8a-b94b-843464a762f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.465776] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('079f6503-3319-4d8a-b94b-843464a762f0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.525026] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.525026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.525026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.525026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.525026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.525026] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.525026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.525026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.525026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.525026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.525026] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c is going to be updated. [ 1149.560309] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.560309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.560309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.560309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.560309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.568168] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: IN_PROGRESS for 2s [ 1149.641543] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.722622] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.913321] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.913321] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.913321] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.913764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.914030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.914136] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29e1de56-440c-4328-94fb-d8f682a71bad already deleted. [ 1149.914136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.969662] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.969790] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.969836] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.970144] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.970299] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.970549] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 079f6503-3319-4d8a-b94b-843464a762f0 not found, creating... [ 1149.970722] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.970886] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.971055] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.971331] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.971597] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.971765] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.971926] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.972225] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.972559] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.972863] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.973045] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 079f6503-3319-4d8a-b94b-843464a762f0 is going to be created. [ 1149.994446] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.994919] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.996240] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.996240] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.996240] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.996240] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-079f6503-3319-4d8a-b94b-843464a762f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.144122] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.144289] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.144360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.144652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.144757] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.144835] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1150.190362] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.190543] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.190600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.190825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.190996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.202149] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1150.225161] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.726933] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.727247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.727371] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.727578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.727692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.727824] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 1150.736309] env[65102]: INFO networking_nsxv3.common.synchronization [req-c8729e8a-70cd-46a4-a55a-1b8cba57370d req-5aa777a5-88a9-4c38-8ffc-3377f7df9b0c service nova] Enqueued Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_rules [ 1150.736309] env[65102]: INFO networking_nsxv3.common.synchronization [req-c8729e8a-70cd-46a4-a55a-1b8cba57370d req-5aa777a5-88a9-4c38-8ffc-3377f7df9b0c service nova] Enqueued Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1150.736309] env[65102]: INFO networking_nsxv3.common.synchronization [req-c8729e8a-70cd-46a4-a55a-1b8cba57370d req-5aa777a5-88a9-4c38-8ffc-3377f7df9b0c service nova] Enqueued Resource ID: 079f6503-3319-4d8a-b94b-843464a762f0 with Priority: HIGHEST for action port [ 1150.736309] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_rules [ 1150.737940] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1150.737940] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 079f6503-3319-4d8a-b94b-843464a762f0 with Priority: HIGHEST for action port [ 1150.737940] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.738112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.738112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.738328] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.738425] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.739671] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.739774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.740053] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-079f6503-3319-4d8a-b94b-843464a762f0 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.740160] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-079f6503-3319-4d8a-b94b-843464a762f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.740225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-079f6503-3319-4d8a-b94b-843464a762f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.740399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-079f6503-3319-4d8a-b94b-843464a762f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.740475] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('079f6503-3319-4d8a-b94b-843464a762f0',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.760111] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.761023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.761023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.761023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.761023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.772543] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 1151.232608] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d17fda10-7148-4558-b429-6c6b75b5f20d in Status: SUCCESS [ 1151.232815] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d17fda10-7148-4558-b429-6c6b75b5f20d deletion is rescheduled due to dependency. [ 1151.232917] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.242493] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.242746] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.242800] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 079f6503-3319-4d8a-b94b-843464a762f0 with status ACTIVE [ 1151.242959] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.243084] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.243151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.243374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.243470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.243739] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.243841] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.243902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.244085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.244209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.244343] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.244457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.244511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.244759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.244836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.244922] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 079f6503-3319-4d8a-b94b-843464a762f0 is going to be updated. [ 1151.288889] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.289061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.289136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.289354] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.289497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.289661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-079f6503-3319-4d8a-b94b-843464a762f0" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.293709] env[65102]: INFO networking_nsxv3.common.synchronization [req-0e9c29b1-ae88-449d-b1c3-ee9c0dbd5808 req-2957ee94-aa54-4b03-ae80-ed15d2b4ce3d tempest-ServersTestJSON-191426844 tempest-ServersTestJSON-191426844-project-member] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1151.294377] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1151.294624] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.294789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.294849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.295070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.295244] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.295345] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.295408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.295575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.295703] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.295798] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.579367] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: SUCCESS [ 1151.579560] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c deletion is rescheduled due to dependency. [ 1151.579678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.579849] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.580084] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.580271] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.580394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.580477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.580610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.580691] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.581660] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.658121] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.658324] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.658462] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.658743] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.659085] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.659268] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.659388] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.659629] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.659790] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.660073] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.660201] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1151.660309] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1151.660434] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1151.660572] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.660695] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1151.660832] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1151.681552] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1151.681552] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1151.681552] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1151.681819] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.682076] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-b633cd1f-f333-4c16-8e85-b43212472666 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.682252] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-b633cd1f-f333-4c16-8e85-b43212472666" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.682393] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-b633cd1f-f333-4c16-8e85-b43212472666" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.682783] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-b633cd1f-f333-4c16-8e85-b43212472666" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.682921] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b633cd1f-f333-4c16-8e85-b43212472666',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.798075] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.084875] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.185454] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.185774] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.185949] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.186330] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.186556] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.186797] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port b633cd1f-f333-4c16-8e85-b43212472666 not found, creating... [ 1152.187154] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.187374] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.187550] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.187878] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.188112] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.188478] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.188644] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.188778] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.189096] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.189312] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.189536] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: b633cd1f-f333-4c16-8e85-b43212472666 is going to be created. [ 1152.211959] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1152.212235] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.212447] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.212698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.212926] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.213078] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.213139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.213325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.213413] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.213501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.213606] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.216844] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.217064] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.217225] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.218818] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.219012] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.219367] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-b633cd1f-f333-4c16-8e85-b43212472666" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.300335] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.587671] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.716241] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.716429] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.716501] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.716926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.717176] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.717292] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.717353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.717522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.717610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.717703] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.717939] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.718112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.718220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.718360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.718505] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.718602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.718672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.718787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.718873] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.718943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.719042] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.784028] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 1152.784332] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.784532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.785100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.785100] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.785100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.785301] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.785347] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.785393] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.785528] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.785606] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.802230] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.802812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.802812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.802812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.802812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.803038] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1152.843310] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.843310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.843600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.843645] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.843772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.857973] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1152.975303] env[65102]: INFO networking_nsxv3.common.synchronization [req-0e9c29b1-ae88-449d-b1c3-ee9c0dbd5808 req-3b3926ff-60ed-49dc-97dc-ffe430c481b2 service nova] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_rules [ 1152.975303] env[65102]: INFO networking_nsxv3.common.synchronization [req-0e9c29b1-ae88-449d-b1c3-ee9c0dbd5808 req-3b3926ff-60ed-49dc-97dc-ffe430c481b2 service nova] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1152.975303] env[65102]: INFO networking_nsxv3.common.synchronization [req-0e9c29b1-ae88-449d-b1c3-ee9c0dbd5808 req-3b3926ff-60ed-49dc-97dc-ffe430c481b2 service nova] Enqueued Resource ID: b633cd1f-f333-4c16-8e85-b43212472666 with Priority: HIGHEST for action port [ 1152.975303] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_rules [ 1152.975303] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1152.975303] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b633cd1f-f333-4c16-8e85-b43212472666 with Priority: HIGHEST for action port [ 1152.975303] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.975981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.976397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.978750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.978750] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.978750] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.978750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.978750] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-b633cd1f-f333-4c16-8e85-b43212472666 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.978750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b633cd1f-f333-4c16-8e85-b43212472666" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.978750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b633cd1f-f333-4c16-8e85-b43212472666" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.979557] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b633cd1f-f333-4c16-8e85-b43212472666" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.979807] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b633cd1f-f333-4c16-8e85-b43212472666',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.091055] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.091055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.091055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.091363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.091514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.091713] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c is going to be updated. [ 1153.145096] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.145269] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.145334] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.145590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.145764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.169279] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: IN_PROGRESS for 2s [ 1153.222689] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59c26ae1-e2ae-453d-a285-e702cf89832f: rpc.has_security_group_logging(os_id): False [ 1153.270961] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.271175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.271175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.271396] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.271493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.271716] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.271851] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.271884] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.272065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.272148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.272357] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.272458] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.272554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.272770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.272863] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.273084] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.273184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.273259] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.273405] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.273486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.273575] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1153.290471] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.290471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.290471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.290471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.290471] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.290471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.290471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.290471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.290471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.290471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.290471] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.290967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.290967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.290967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.290967] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.290967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.290967] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.291306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.291306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.291408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.291441] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.378538] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.378796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.378796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.378972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.379144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.398895] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1153.482497] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.482726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.482873] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b633cd1f-f333-4c16-8e85-b43212472666 with status ACTIVE [ 1153.483072] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.484028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.484028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.484028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.484028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.484028] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.484028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.484028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.484028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.484623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.484623] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.484623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.484623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.484623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.484623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.484800] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b633cd1f-f333-4c16-8e85-b43212472666 is going to be updated. [ 1153.532889] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.533043] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.533799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.533799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.533799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.533906] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b633cd1f-f333-4c16-8e85-b43212472666" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.794403] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a0c01bc-dc67-4824-bf8b-60c7f41f292f: rpc.has_security_group_logging(os_id): False [ 1153.815648] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.816059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.816059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.816133] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.816179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.816371] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.816469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.816533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.816686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.816766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.816968] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.817081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.817144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.817284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.817358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.817536] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.817631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.817695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.817830] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.817905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.817994] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 1153.886078] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.886279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.886375] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.886647] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.886838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.901430] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 1154.875728] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1154.876083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.876158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.876412] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.876588] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.876785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.876785] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.876919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.877009] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.877109] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.181467] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: SUCCESS [ 1155.181720] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.181927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.182185] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.182406] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.182549] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.182655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.182903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.183045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.183163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.183273] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.379694] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.416373] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1155.416373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.687030] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.687030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.687030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.687030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.687030] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.687030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.687030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.687977] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.688319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.688561] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.689020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.689020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.691073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.691073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.691073] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.691073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.691073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.691073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.691073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.691073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.691073] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.882675] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.916538] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 1155.916922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.193998] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0f8a62e-96a1-4434-a694-20df67619d3c: rpc.has_security_group_logging(os_id): False [ 1156.214378] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.214819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.214819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.215279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.215279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.215279] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.215279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.215673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.215673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.215673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.215883] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.215883] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.216179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.216179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.216179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.216404] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.216471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.216542] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.216686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.216758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.216799] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c is going to be updated. [ 1156.260198] env[65102]: INFO networking_nsxv3.common.synchronization [req-269409d6-afe8-4537-8089-bd0f2b3510b5 req-830ecd85-3b84-4ba3-b3c5-eecbea82e5ba tempest-AttachVolumeTestJSON-843685348 tempest-AttachVolumeTestJSON-843685348-project-member] Enqueued Resource ID: 29e1de56-440c-4328-94fb-d8f682a71bad with Priority: HIGHEST for action security_group_members [ 1156.260198] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29e1de56-440c-4328-94fb-d8f682a71bad with Priority: HIGHEST for action security_group_members [ 1156.260198] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29e1de56-440c-4328-94fb-d8f682a71bad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.263221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.263473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.263822] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.264120] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.264344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.264591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.264990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.265188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.265456] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29e1de56-440c-4328-94fb-d8f682a71bad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.294225] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.294225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.294225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.294225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.294225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.310955] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: IN_PROGRESS for 2s [ 1156.385830] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.386045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.386100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.386324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.386412] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.386514] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1156.439459] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.439459] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.439459] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.439459] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.439731] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.450857] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1156.643120] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.643120] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-367" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.643284] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-367" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.643537] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-367" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.643775] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.643931] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.644060] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.644278] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.644430] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.644743] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.644867] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.645338] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.645338] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.645338] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.645338] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.645503] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.666916] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.667123] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1156.667270] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.667458] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-367" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.667875] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-13b14810-c694-4e47-b090-8c3bf39ad510 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.668027] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-13b14810-c694-4e47-b090-8c3bf39ad510" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.668135] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-13b14810-c694-4e47-b090-8c3bf39ad510" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.668468] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-13b14810-c694-4e47-b090-8c3bf39ad510" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.668608] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13b14810-c694-4e47-b090-8c3bf39ad510',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.769394] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.769855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.769945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.770126] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.770218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.770429] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.770552] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.770839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.771107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.771107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.771192] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29e1de56-440c-4328-94fb-d8f682a71bad already deleted. [ 1156.771282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.171175] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.171516] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.171687] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.172035] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.172316] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.172593] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 13b14810-c694-4e47-b090-8c3bf39ad510 not found, creating... [ 1157.173060] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.173353] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.173548] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.173827] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.174064] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.174447] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.174735] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.174904] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.175173] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.175385] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.175650] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 13b14810-c694-4e47-b090-8c3bf39ad510 is going to be created. [ 1157.197256] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.198057] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.198057] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.198396] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.198791] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.199188] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-13b14810-c694-4e47-b090-8c3bf39ad510" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.918342] env[65102]: INFO networking_nsxv3.common.synchronization [req-269409d6-afe8-4537-8089-bd0f2b3510b5 req-8034afa5-38e9-49bc-90b8-c48541ae787f service nova] Enqueued Resource ID: 29e1de56-440c-4328-94fb-d8f682a71bad with Priority: HIGHEST for action security_group_rules [ 1157.918550] env[65102]: INFO networking_nsxv3.common.synchronization [req-269409d6-afe8-4537-8089-bd0f2b3510b5 req-8034afa5-38e9-49bc-90b8-c48541ae787f service nova] Enqueued Resource ID: 29e1de56-440c-4328-94fb-d8f682a71bad with Priority: HIGHEST for action security_group_members [ 1157.918658] env[65102]: INFO networking_nsxv3.common.synchronization [req-269409d6-afe8-4537-8089-bd0f2b3510b5 req-8034afa5-38e9-49bc-90b8-c48541ae787f service nova] Enqueued Resource ID: 13b14810-c694-4e47-b090-8c3bf39ad510 with Priority: HIGHEST for action port [ 1157.919389] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29e1de56-440c-4328-94fb-d8f682a71bad with Priority: HIGHEST for action security_group_rules [ 1157.919471] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29e1de56-440c-4328-94fb-d8f682a71bad with Priority: HIGHEST for action security_group_members [ 1157.919572] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b14810-c694-4e47-b090-8c3bf39ad510 with Priority: HIGHEST for action port [ 1157.919929] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29e1de56-440c-4328-94fb-d8f682a71bad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.920208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.920208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.920339] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.920435] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29e1de56-440c-4328-94fb-d8f682a71bad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.921366] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29e1de56-440c-4328-94fb-d8f682a71bad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.922014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.922014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.922014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.922014] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.922014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.922014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.922299] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.922299] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.922355] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29e1de56-440c-4328-94fb-d8f682a71bad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.923105] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-13b14810-c694-4e47-b090-8c3bf39ad510 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.923216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13b14810-c694-4e47-b090-8c3bf39ad510" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.923502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13b14810-c694-4e47-b090-8c3bf39ad510" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.923502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13b14810-c694-4e47-b090-8c3bf39ad510" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.923753] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13b14810-c694-4e47-b090-8c3bf39ad510',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.325542] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: SUCCESS [ 1158.325985] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.425717] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29e1de56-440c-4328-94fb-d8f682a71bad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.425932] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.426240] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29e1de56-440c-4328-94fb-d8f682a71bad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.427631] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13b14810-c694-4e47-b090-8c3bf39ad510 with status ACTIVE [ 1158.427913] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.428102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.428226] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.428543] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.428701] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.428981] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.429175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.429292] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.429544] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.429703] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.430007] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.430186] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.430302] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.430536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.430697] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.430843] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13b14810-c694-4e47-b090-8c3bf39ad510 is going to be updated. [ 1158.454600] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.454904] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.455016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.455341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.455582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.455856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13b14810-c694-4e47-b090-8c3bf39ad510" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.465949] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1158.466299] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.466569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.466899] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.467215] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.467412] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.467538] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.467801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.467941] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.468113] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.468287] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.590893] env[65102]: INFO networking_nsxv3.common.synchronization [req-48ca426f-55e5-43bf-8a8d-152e5c28737b req-088b9582-3f5b-4549-b5c7-9bd9e7e8d294 tempest-ServersNegativeTestJSON-56640959 tempest-ServersNegativeTestJSON-56640959-project-member] Enqueued Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_members [ 1158.592156] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_members [ 1158.592559] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.592691] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.592755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.592953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.593345] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.593455] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.593514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.593745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.593803] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.593864] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.933278] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29e1de56-440c-4328-94fb-d8f682a71bad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.947712] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-198 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.947977] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-198" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.948167] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-198" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.948471] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-198" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.948772] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.948969] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.949141] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.949388] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.949595] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.949841] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1158.949961] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1158.950089] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1158.950200] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1158.950314] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1158.950532] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1158.950601] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1158.970099] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1158.970316] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1158.970485] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1158.970585] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-198" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.971206] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-ebe5fc14-2b6a-40f0-80c2-2f843e929082 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.971206] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-ebe5fc14-2b6a-40f0-80c2-2f843e929082" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.971400] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-ebe5fc14-2b6a-40f0-80c2-2f843e929082" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.971729] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-ebe5fc14-2b6a-40f0-80c2-2f843e929082" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.971876] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebe5fc14-2b6a-40f0-80c2-2f843e929082',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.973226] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.973374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.973424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.973582] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.973742] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.973840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.973905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.974158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.975566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.975640] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.975872] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.976054] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.976140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.976370] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.976680] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.976859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.976947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.978109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.978207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.978301] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.978419] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.095911] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.440519] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.440969] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.441125] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.441478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.441634] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.441815] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29e1de56-440c-4328-94fb-d8f682a71bad is going to be created. [ 1159.471575] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.471831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.471831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.472017] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.472198] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.480756] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.481050] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.481185] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.481480] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.481643] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.481815] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port ebe5fc14-2b6a-40f0-80c2-2f843e929082 not found, creating... [ 1159.482104] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.482272] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.482393] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.482684] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.482838] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.483163] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.483373] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.483501] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.483728] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.483868] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.484023] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: ebe5fc14-2b6a-40f0-80c2-2f843e929082 is going to be created. [ 1159.486102] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29e1de56-440c-4328-94fb-d8f682a71bad in Status: UNINITIALIZED for 2s [ 1159.486292] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8746f52-1411-469d-8df9-8b15536649f6: rpc.has_security_group_logging(os_id): False [ 1159.507093] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.507372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.507372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.507569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.507664] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.507887] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.507980] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.508069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.508219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.508309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.508486] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.508581] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.508644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.508790] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.508866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.509143] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.509246] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.509410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.509644] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.509706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.509831] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1159.512161] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.512401] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.512590] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.512851] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.513213] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.513544] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-ebe5fc14-2b6a-40f0-80c2-2f843e929082" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.599112] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.626131] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.626349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.626349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.626587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.626774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.653348] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1160.101817] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.102590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.102590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.102590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.102590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.102590] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 is going to be updated. [ 1160.137094] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.137324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.137398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.137689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.137890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.152338] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: IN_PROGRESS for 2s [ 1160.237882] env[65102]: INFO networking_nsxv3.common.synchronization [req-48ca426f-55e5-43bf-8a8d-152e5c28737b req-11640b60-338a-4c56-af61-20e21396ab19 service nova] Enqueued Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_rules [ 1160.238199] env[65102]: INFO networking_nsxv3.common.synchronization [req-48ca426f-55e5-43bf-8a8d-152e5c28737b req-11640b60-338a-4c56-af61-20e21396ab19 service nova] Enqueued Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_members [ 1160.238415] env[65102]: INFO networking_nsxv3.common.synchronization [req-48ca426f-55e5-43bf-8a8d-152e5c28737b req-11640b60-338a-4c56-af61-20e21396ab19 service nova] Enqueued Resource ID: ebe5fc14-2b6a-40f0-80c2-2f843e929082 with Priority: HIGHEST for action port [ 1160.239267] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_rules [ 1160.239514] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_members [ 1160.239911] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebe5fc14-2b6a-40f0-80c2-2f843e929082 with Priority: HIGHEST for action port [ 1160.240194] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.240469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.240469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.240764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.240908] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.242332] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.242480] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.242836] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebe5fc14-2b6a-40f0-80c2-2f843e929082 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.243036] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebe5fc14-2b6a-40f0-80c2-2f843e929082" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.243104] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebe5fc14-2b6a-40f0-80c2-2f843e929082" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.243402] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebe5fc14-2b6a-40f0-80c2-2f843e929082" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.243530] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebe5fc14-2b6a-40f0-80c2-2f843e929082',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.460409] env[65102]: INFO networking_nsxv3.common.synchronization [req-478f76ca-e7b3-40e8-9f0f-479ffaeef6fb req-c5cd40a9-ebcb-445c-9f89-7b874ee1250d tempest-ServerDiskConfigTestJSON-1771527805 tempest-ServerDiskConfigTestJSON-1771527805-project-member] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1160.461271] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGHEST for action security_group_members [ 1160.461628] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.461797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.461845] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.462313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.462372] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.462545] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.462616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.462826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.462921] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.463059] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.745716] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.745911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.746157] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebe5fc14-2b6a-40f0-80c2-2f843e929082 with status ACTIVE [ 1160.746357] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.746476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.746550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.746772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.746861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.747056] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.747149] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.747209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.747369] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.747435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.747657] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.747761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.747813] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.747937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.747997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.748097] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebe5fc14-2b6a-40f0-80c2-2f843e929082 is going to be updated. [ 1160.775517] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.775674] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.775735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.775935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.776088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.776253] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebe5fc14-2b6a-40f0-80c2-2f843e929082" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.965777] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.966121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.966280] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.966648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.966833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.967238] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.967678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.967678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.967847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.967964] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.968144] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be updated. [ 1161.004869] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.005246] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.005376] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.005710] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.005911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.019815] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: IN_PROGRESS for 2s [ 1161.497638] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29e1de56-440c-4328-94fb-d8f682a71bad in Status: SUCCESS [ 1161.497954] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.498862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.498862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.498862] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.498862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.498862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.498862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.498862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.499163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.499163] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29e1de56-440c-4328-94fb-d8f682a71bad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.670759] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1161.671060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.001885] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29e1de56-440c-4328-94fb-d8f682a71bad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.174066] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: SUCCESS [ 1162.174066] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.174721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.174721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.174899] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.175112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.175247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.175539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.175692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.175849] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.503960] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29e1de56-440c-4328-94fb-d8f682a71bad: rpc.has_security_group_logging(os_id): False [ 1162.533103] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.533213] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.533258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.533453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.533641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.533984] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.534130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.534240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.534532] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.534639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.534784] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29e1de56-440c-4328-94fb-d8f682a71bad is going to be created. [ 1162.626666] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.627016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.627016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.627122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.627332] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.644019] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29e1de56-440c-4328-94fb-d8f682a71bad in Status: IN_PROGRESS for 2s [ 1162.679163] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.031430] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f in Status: SUCCESS [ 1163.031666] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f deletion is rescheduled due to dependency. [ 1163.031819] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.181438] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.684109] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.684557] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.684557] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.684824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.684922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.685178] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 is going to be updated. [ 1163.738038] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.738165] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.738227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.738483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.738641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.765355] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: IN_PROGRESS for 2s [ 1164.524876] env[65102]: INFO networking_nsxv3.common.synchronization [req-19001f15-ad4e-4f87-9992-fcb830d113b1 req-e125d4bf-a5b1-4590-9e53-2a35274b5edb tempest-ServersTestJSON-191426844 tempest-ServersTestJSON-191426844-project-member] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1164.525208] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1164.525541] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.525667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.525733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.525929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.526206] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.526312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.526424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.526578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.526675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.526805] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.656532] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29e1de56-440c-4328-94fb-d8f682a71bad in Status: SUCCESS [ 1164.656783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.851496] env[65102]: INFO networking_nsxv3.common.synchronization [req-cdb4c112-d7c0-44ec-87e4-7403a9f2dc10 req-eb24b5e2-6257-42b0-951e-901389035986 tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_members [ 1164.852079] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_members [ 1164.852399] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4501856-910f-4bf4-9fd2-4d3675738a94 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.852520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.852586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.852784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.855300] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.855300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.855300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.855300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.855300] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.855300] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.029039] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.357230] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.532563] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.780456] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: SUCCESS [ 1165.780662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.780839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.781094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.781322] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.781444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.781505] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.781669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.781764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.781831] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.781898] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.860021] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.034245] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.034463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.034463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.034729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.034825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.035093] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1166.104313] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.104529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.104529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.104728] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.104959] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.118803] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1166.284638] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.285622] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.286587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.286587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.286587] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.286587] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.286824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.286824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.286886] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.287093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.287161] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.287208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.287259] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.287400] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.287536] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.287622] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.287681] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.287817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.287891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.287968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.288077] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.363682] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.363903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.364035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.364328] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.364550] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.365361] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4501856-910f-4bf4-9fd2-4d3675738a94 is going to be updated. [ 1166.409451] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.409451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.409451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.409451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.409451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.422840] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4501856-910f-4bf4-9fd2-4d3675738a94 in Status: IN_PROGRESS for 2s [ 1166.790840] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e9c3133-b79e-4eb2-8ba0-d484113ac747: rpc.has_security_group_logging(os_id): False [ 1166.813525] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.813717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.813820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.814611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.814611] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.814611] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.814894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.814894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.814966] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.815035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.815231] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.815366] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.815491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.815575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.815774] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.815898] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.815972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.816030] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.816158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.816234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.816320] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 is going to be updated. [ 1166.918154] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.918465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.918465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.920763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.920763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.944972] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: IN_PROGRESS for 2s [ 1168.130907] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1168.130907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.433890] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4501856-910f-4bf4-9fd2-4d3675738a94 in Status: SUCCESS [ 1168.434180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.961307] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: SUCCESS [ 1168.961528] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.853254] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1169.853636] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1170.783965] env[65102]: INFO networking_nsxv3.common.synchronization [req-afbdc8fa-1fb2-4ec5-83d0-cc7796eacc96 req-6f372abf-953b-4c6f-ab9d-a1d790bb8341 tempest-ServersNegativeTestJSON-56640959 tempest-ServersNegativeTestJSON-56640959-project-member] Enqueued Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_members [ 1170.784697] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_members [ 1170.785107] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.785253] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.785325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.785539] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.785734] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.785850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.785914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.786103] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.786199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.786302] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.808217] env[65102]: INFO networking_nsxv3.common.synchronization [req-ed14f355-c4c3-4ded-a6be-95bc118949cd req-e86f26d6-66a2-4531-a7f1-8e11642541b7 tempest-ServersTestJSON-191426844 tempest-ServersTestJSON-191426844-project-member] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1170.808668] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1170.808982] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.809114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.809182] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.809373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.809527] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.809625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.809685] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.809827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.809911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.810016] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.289070] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.314734] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.791763] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.818631] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.294529] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.296253] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.296253] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.296253] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.296253] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.296253] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 is going to be updated. [ 1172.323116] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.323351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.323444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.323705] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.323795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.323899] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1172.365420] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.365684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.365684] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.365853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.366019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.379505] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: IN_PROGRESS for 2s [ 1172.383818] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.384069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.384069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.384243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.384390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.394292] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1173.153191] env[65102]: INFO networking_nsxv3.common.synchronization [req-c07d18e5-f9ca-4e55-b98c-2857ea9e532a req-6d4d7157-1f12-4255-9b78-bead3cf19ad9 tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_members [ 1173.153944] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGHEST for action security_group_members [ 1173.154069] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4501856-910f-4bf4-9fd2-4d3675738a94 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.154198] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.154264] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.154499] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.154654] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.154752] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.154815] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.154963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.155059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.155152] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.509142] env[65102]: INFO networking_nsxv3.common.synchronization [req-a45c9879-a98d-4074-85b9-b2d751132ce6 req-174ce067-916e-4eca-9f93-7412b6e7f328 tempest-ImagesOneServerNegativeTestJSON-1910886864 tempest-ImagesOneServerNegativeTestJSON-1910886864-project-member] Enqueued Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1173.509692] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1173.510013] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.510164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.510230] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.510429] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.510581] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.510676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.510739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.510883] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.511430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.511430] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.658452] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.658661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.658661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.658898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.659019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.659230] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.659333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.659407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.659573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.659667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.659755] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4501856-910f-4bf4-9fd2-4d3675738a94 is going to be updated. [ 1173.692427] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.692683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.692683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.692856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.693011] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.703041] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4501856-910f-4bf4-9fd2-4d3675738a94 in Status: IN_PROGRESS for 2s [ 1174.013973] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.014122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.014122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.014483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.014679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.014954] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.015141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.015257] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.015534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.015655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.015799] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c is going to be updated. [ 1174.047651] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.047852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.047892] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.048138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.048285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.059449] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: IN_PROGRESS for 2s [ 1174.391898] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: SUCCESS [ 1174.392305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.410203] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1174.410422] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.715670] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4501856-910f-4bf4-9fd2-4d3675738a94 in Status: SUCCESS [ 1175.716663] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4501856-910f-4bf4-9fd2-4d3675738a94 deletion is rescheduled due to dependency. [ 1175.716663] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.070832] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: SUCCESS [ 1176.071098] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c deletion is rescheduled due to dependency. [ 1176.071244] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.510479] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1178.510769] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1178.747647] env[65102]: INFO networking_nsxv3.common.synchronization [None req-08ed9a08-831b-4298-8a79-884fef446a13 tempest-AttachInterfacesTestJSON-1317707612 tempest-AttachInterfacesTestJSON-1317707612-project-member] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1178.748072] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGHEST for action security_group_members [ 1178.748671] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.748671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.748829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.749106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.749368] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.749535] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.749641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.750015] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.750176] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.750333] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.253967] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.254106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.254106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.254608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.254608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.254721] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.256239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.256239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.256239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.256239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.256239] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be updated. [ 1179.291463] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.291754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.291754] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.291850] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.291988] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.303425] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: IN_PROGRESS for 2s [ 1181.319494] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59c26ae1-e2ae-453d-a285-e702cf89832f in Status: SUCCESS [ 1181.319879] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f deletion is rescheduled due to dependency. [ 1181.319879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.264629] env[65102]: INFO networking_nsxv3.common.synchronization [req-866ab70f-6145-44f8-bbcf-182b7283168c req-cd0d292a-9b32-41de-b5d9-90fb26bcb6d4 tempest-ServersTestJSON-191426844 tempest-ServersTestJSON-191426844-project-member] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1182.265193] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1182.265867] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.266032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.266346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.266575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.266872] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.267036] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.267075] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.267433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.267433] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.267433] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.597510] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.597804] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.597893] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.598204] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.598505] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.598671] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.598787] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.599010] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.599164] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.599372] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1182.599539] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1182.599911] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1182.600059] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1182.600183] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1182.600298] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1182.600435] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1182.622064] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1182.622232] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1182.622232] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1182.622445] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.622771] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-c54e07bb-9d9b-4424-84ec-301f0abb7e4e taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.622977] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-c54e07bb-9d9b-4424-84ec-301f0abb7e4e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.623102] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-c54e07bb-9d9b-4424-84ec-301f0abb7e4e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.623417] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-c54e07bb-9d9b-4424-84ec-301f0abb7e4e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.623560] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c54e07bb-9d9b-4424-84ec-301f0abb7e4e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.769909] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.125732] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.126094] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.126240] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.126740] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.126891] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.127067] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port c54e07bb-9d9b-4424-84ec-301f0abb7e4e not found, creating... [ 1183.127369] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.127591] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.127728] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.128034] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.128237] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.128534] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.128687] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.128801] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.129148] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.129231] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.129405] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: c54e07bb-9d9b-4424-84ec-301f0abb7e4e is going to be created. [ 1183.157043] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.157043] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.157043] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.157341] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.157588] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.157822] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-c54e07bb-9d9b-4424-84ec-301f0abb7e4e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.273110] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.775620] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.775935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.775935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.776138] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.776287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.776426] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1183.807055] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.807228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.807311] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.807529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.807699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.817755] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1183.866451] env[65102]: INFO networking_nsxv3.common.synchronization [req-866ab70f-6145-44f8-bbcf-182b7283168c req-98663cd5-08ad-469f-a7a9-c990f85f3b6b service nova] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_rules [ 1183.866645] env[65102]: INFO networking_nsxv3.common.synchronization [req-866ab70f-6145-44f8-bbcf-182b7283168c req-98663cd5-08ad-469f-a7a9-c990f85f3b6b service nova] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1183.866848] env[65102]: INFO networking_nsxv3.common.synchronization [req-866ab70f-6145-44f8-bbcf-182b7283168c req-98663cd5-08ad-469f-a7a9-c990f85f3b6b service nova] Enqueued Resource ID: c54e07bb-9d9b-4424-84ec-301f0abb7e4e with Priority: HIGHEST for action port [ 1183.867606] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_rules [ 1183.867788] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1183.867982] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54e07bb-9d9b-4424-84ec-301f0abb7e4e with Priority: HIGHEST for action port [ 1183.868337] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.868472] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.868554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.868818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.868854] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.870260] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.870428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.870693] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-c54e07bb-9d9b-4424-84ec-301f0abb7e4e taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.870825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c54e07bb-9d9b-4424-84ec-301f0abb7e4e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.870905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c54e07bb-9d9b-4424-84ec-301f0abb7e4e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.871158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c54e07bb-9d9b-4424-84ec-301f0abb7e4e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.871258] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c54e07bb-9d9b-4424-84ec-301f0abb7e4e',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.373585] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.373936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.374070] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c54e07bb-9d9b-4424-84ec-301f0abb7e4e with status ACTIVE [ 1184.374312] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.374519] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.374618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.374860] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.374961] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.375152] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.375250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.375313] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.375474] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.375554] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.375750] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.375857] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.375888] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.376033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.376110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.376203] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c54e07bb-9d9b-4424-84ec-301f0abb7e4e is going to be updated. [ 1184.397893] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.398074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.398134] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.398351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.398503] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.398692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c54e07bb-9d9b-4424-84ec-301f0abb7e4e" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.323289] env[65102]: INFO networking_nsxv3.common.synchronization [req-72091f5a-e0ec-413e-82d2-f1d0b36c1d24 req-6540c615-ee6c-4b13-a7af-a95137fb6527 tempest-ImagesOneServerNegativeTestJSON-1910886864 tempest-ImagesOneServerNegativeTestJSON-1910886864-project-member] Enqueued Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1185.324415] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1185.324848] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.325143] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.325263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.325516] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.325735] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.325893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.325996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.326232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.326373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.326516] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.655018] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.655018] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-844" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.655018] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-844" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.655018] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-844" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.655018] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.655018] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.655018] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.655018] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.655642] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.655973] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.656205] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1185.656409] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1185.656601] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1185.656839] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1185.657049] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1185.657268] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1185.676735] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1185.676942] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1185.677127] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1185.677328] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-844" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.677658] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-3a1da1f7-19b4-4cb6-81d4-59775cea63dc taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.677833] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-3a1da1f7-19b4-4cb6-81d4-59775cea63dc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.677955] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-3a1da1f7-19b4-4cb6-81d4-59775cea63dc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.678461] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-3a1da1f7-19b4-4cb6-81d4-59775cea63dc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.678603] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a1da1f7-19b4-4cb6-81d4-59775cea63dc',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.829056] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1185.829368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.829905] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.830135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.830230] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.830492] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.830613] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.830853] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.830974] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.831978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.832285] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.832430] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.832582] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c is going to be updated. [ 1185.834529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.834802] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.835065] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.835240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.835357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.835664] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.835804] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.836032] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.865104] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.865104] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.865104] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.865104] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.865104] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.875621] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: IN_PROGRESS for 2s [ 1186.180622] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.180890] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.181030] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.181326] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.181480] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.181641] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 3a1da1f7-19b4-4cb6-81d4-59775cea63dc not found, creating... [ 1186.181911] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.182143] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.182247] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.182464] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.182606] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.182906] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.183099] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.183203] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.183399] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.183535] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.183674] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 3a1da1f7-19b4-4cb6-81d4-59775cea63dc is going to be created. [ 1186.230617] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.230894] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.231039] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.231334] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.231591] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.231857] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-3a1da1f7-19b4-4cb6-81d4-59775cea63dc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.339164] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.841178] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.918297] env[65102]: INFO networking_nsxv3.common.synchronization [req-72091f5a-e0ec-413e-82d2-f1d0b36c1d24 req-dcf19849-b10a-408a-b948-64698b4dc415 service nova] Enqueued Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_rules [ 1186.918481] env[65102]: INFO networking_nsxv3.common.synchronization [req-72091f5a-e0ec-413e-82d2-f1d0b36c1d24 req-dcf19849-b10a-408a-b948-64698b4dc415 service nova] Enqueued Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1186.918624] env[65102]: INFO networking_nsxv3.common.synchronization [req-72091f5a-e0ec-413e-82d2-f1d0b36c1d24 req-dcf19849-b10a-408a-b948-64698b4dc415 service nova] Enqueued Resource ID: 3a1da1f7-19b4-4cb6-81d4-59775cea63dc with Priority: HIGHEST for action port [ 1186.919168] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_rules [ 1186.919312] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1186.919412] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a1da1f7-19b4-4cb6-81d4-59775cea63dc with Priority: HIGHEST for action port [ 1186.919945] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.920146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.920218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.920461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.920557] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.921525] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.921525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.921677] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a1da1f7-19b4-4cb6-81d4-59775cea63dc taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.921769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a1da1f7-19b4-4cb6-81d4-59775cea63dc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.921834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a1da1f7-19b4-4cb6-81d4-59775cea63dc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.922052] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a1da1f7-19b4-4cb6-81d4-59775cea63dc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.922113] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a1da1f7-19b4-4cb6-81d4-59775cea63dc',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.344742] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.345210] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.345210] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.345210] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.345343] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.345388] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1187.376406] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.376633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.376691] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.376904] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.377064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.387489] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1187.424078] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.424222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.424532] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a1da1f7-19b4-4cb6-81d4-59775cea63dc with status ACTIVE [ 1187.424710] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.424821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.425107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.425107] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.425188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.425354] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.425466] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.425528] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.425683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.425758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.425955] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.426072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.426106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.426316] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.426390] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.426578] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a1da1f7-19b4-4cb6-81d4-59775cea63dc is going to be updated. [ 1187.450263] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.450468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.450468] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.450770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.450963] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.451197] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a1da1f7-19b4-4cb6-81d4-59775cea63dc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.887589] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: SUCCESS [ 1187.887782] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c deletion is rescheduled due to dependency. [ 1187.887942] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.888095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.888393] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.888808] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.888949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.889031] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.889206] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.889293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.889429] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.393547] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.896315] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.398430] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1189.398824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.399021] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.399292] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.399356] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.399572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.399690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.399805] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c is going to be updated. [ 1189.400820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.401088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.401341] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.401496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.401628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.401808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.401933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.402039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.402165] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.456226] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.456607] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.456726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.456970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.457145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.467340] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: IN_PROGRESS for 2s [ 1189.904859] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.905273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.905273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.905396] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.905558] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.905666] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.905749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.905916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.906033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.906128] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.906334] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.906441] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.906520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.906675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.906847] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.906939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.906999] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.907176] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.907257] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.907341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.907436] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.410338] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8746f52-1411-469d-8df9-8b15536649f6: rpc.has_security_group_logging(os_id): False [ 1190.429333] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.429538] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.429538] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.429709] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.429847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.430067] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.430172] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.430236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.430391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.430473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.430653] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.430822] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.430924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.431106] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.431234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.431602] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.431753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.431829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.432042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.432177] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.432313] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1190.504582] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.504847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.504912] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.505125] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.505277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.524646] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1191.479612] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: SUCCESS [ 1191.480009] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.480009] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.480188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.480390] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.480511] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.480581] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.480742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.480829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.480917] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.481254] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.920100] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1191.920283] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1191.983947] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.984222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.984287] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.984607] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.984998] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.984998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.985199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.985269] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.985412] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.985639] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.985821] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.985965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.986056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.986297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.986502] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.986678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.986781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.986987] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.987104] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.987245] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.987376] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.490204] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0f8a62e-96a1-4434-a694-20df67619d3c: rpc.has_security_group_logging(os_id): False [ 1192.512235] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.512453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.512453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.512676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.512770] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.512979] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.513091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.513148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.513281] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.513360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.513606] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.513702] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.513766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.513934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.514071] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.514234] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.514357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.514414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.514545] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.514624] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.514713] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c is going to be updated. [ 1192.540162] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1192.540475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.586739] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.586908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.586978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.587260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.587408] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.601554] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: IN_PROGRESS for 2s [ 1194.145358] env[65102]: INFO networking_nsxv3.common.synchronization [req-10263e68-0821-4152-910e-ff97b1041caa req-303542db-cd87-4afa-bdd3-69c4f46249d6 tempest-ServersTestJSON-191426844 tempest-ServersTestJSON-191426844-project-member] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1194.146184] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1194.146556] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.146706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.146795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.147042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.147254] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.147434] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.147434] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.147636] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.147699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.147818] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.617031] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: SUCCESS [ 1194.617222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.650922] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.153960] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.656894] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.657123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.657234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.657496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.657608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.657712] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1195.691451] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.691609] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.691727] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.691960] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.692127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.703379] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1197.522050] env[65102]: INFO networking_nsxv3.common.synchronization [req-c687b698-a60b-4679-9671-befe6a4ebbf5 req-35665e08-f9c2-4aea-a334-1c323bae88eb tempest-ImagesOneServerNegativeTestJSON-1910886864 tempest-ImagesOneServerNegativeTestJSON-1910886864-project-member] Enqueued Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1197.522819] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGHEST for action security_group_members [ 1197.523476] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.523589] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.525050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.525050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.525050] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.525050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.525050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.525050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.525050] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.525050] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.718090] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1197.718319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.028547] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.028779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.028843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.029736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.029736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.029736] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.029736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.029736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.030056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.030056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.030056] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c is going to be updated. [ 1198.066672] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.066926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.066926] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.067169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.067319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.078936] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: IN_PROGRESS for 2s [ 1200.104557] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0f8a62e-96a1-4434-a694-20df67619d3c in Status: SUCCESS [ 1200.104971] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c deletion is rescheduled due to dependency. [ 1200.104971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.523861] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1202.524271] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1206.930629] env[65102]: INFO networking_nsxv3.common.synchronization [req-52434ee9-28f6-4845-863e-f46ed94b1ef3 req-6eeaea75-c13d-4081-a14d-d621232a08c1 tempest-ServersTestJSON-191426844 tempest-ServersTestJSON-191426844-project-member] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1206.931191] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1206.931808] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.931945] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.932045] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.932697] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.932697] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.932697] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.932697] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.932920] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.932920] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.932920] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.281140] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.281286] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.281389] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.281643] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.282297] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.282512] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.282562] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.282789] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.282948] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.283181] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1207.283300] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1207.283410] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1207.283548] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1207.283648] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1207.283759] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1207.283893] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1207.308546] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1207.308546] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1207.308711] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1207.308820] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-527" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.309157] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-6af11f76-b4de-4137-b77f-a285924025d9 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.309333] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-6af11f76-b4de-4137-b77f-a285924025d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.309454] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-6af11f76-b4de-4137-b77f-a285924025d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.310244] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-6af11f76-b4de-4137-b77f-a285924025d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.310244] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6af11f76-b4de-4137-b77f-a285924025d9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.435406] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.812749] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.812973] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.813093] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.813337] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.813487] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.813642] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 6af11f76-b4de-4137-b77f-a285924025d9 not found, creating... [ 1207.813992] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.814170] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.814291] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.814550] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.814689] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.814970] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.815143] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.815259] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.815465] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.815601] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.815739] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 6af11f76-b4de-4137-b77f-a285924025d9 is going to be created. [ 1207.837620] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.837620] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.837620] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.837896] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.838060] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.838289] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-6af11f76-b4de-4137-b77f-a285924025d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.938131] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.441620] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.441620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.441620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.441620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.441620] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.441620] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1208.470170] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.470340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.470379] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.470580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.470731] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.480371] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1208.553636] env[65102]: INFO networking_nsxv3.common.synchronization [req-52434ee9-28f6-4845-863e-f46ed94b1ef3 req-4a550138-b40f-4ed1-ad25-76931e4d7f8e service nova] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_rules [ 1208.553773] env[65102]: INFO networking_nsxv3.common.synchronization [req-52434ee9-28f6-4845-863e-f46ed94b1ef3 req-4a550138-b40f-4ed1-ad25-76931e4d7f8e service nova] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1208.553905] env[65102]: INFO networking_nsxv3.common.synchronization [req-52434ee9-28f6-4845-863e-f46ed94b1ef3 req-4a550138-b40f-4ed1-ad25-76931e4d7f8e service nova] Enqueued Resource ID: 6af11f76-b4de-4137-b77f-a285924025d9 with Priority: HIGHEST for action port [ 1208.554460] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_rules [ 1208.554597] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1208.555756] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6af11f76-b4de-4137-b77f-a285924025d9 with Priority: HIGHEST for action port [ 1208.556360] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.556360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.556360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.556538] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.556632] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.557516] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.557631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.557849] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-6af11f76-b4de-4137-b77f-a285924025d9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.557955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6af11f76-b4de-4137-b77f-a285924025d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.558032] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6af11f76-b4de-4137-b77f-a285924025d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.558279] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6af11f76-b4de-4137-b77f-a285924025d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.558310] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6af11f76-b4de-4137-b77f-a285924025d9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.060699] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.060699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.062033] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6af11f76-b4de-4137-b77f-a285924025d9 with status ACTIVE [ 1209.063020] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.063020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.063020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.063020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.063020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.063361] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.063486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.063590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.063847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.064167] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.064505] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.064625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.064689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.064838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.065706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.065706] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6af11f76-b4de-4137-b77f-a285924025d9 is going to be updated. [ 1209.086791] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.086982] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.087048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.087270] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.087407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.087571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6af11f76-b4de-4137-b77f-a285924025d9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.490544] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1210.490965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.490965] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.491233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.491423] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.491540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.491606] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.491758] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.491839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.491935] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.994059] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.496740] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.000120] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.000333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.000403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.000572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.000658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.000759] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1212.043024] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.043024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.043024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.043024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.043024] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.054521] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1212.981808] env[65102]: INFO networking_nsxv3.common.synchronization [req-f53c826f-9524-4390-9223-69485bda2e0e req-30304126-0a4e-4042-8860-386cc481c62c tempest-AttachVolumeNegativeTest-1325286790 tempest-AttachVolumeNegativeTest-1325286790-project-member] Enqueued Resource ID: 43c26daa-d251-465e-af14-279e7838d2a3 with Priority: HIGHEST for action security_group_members [ 1212.982561] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c26daa-d251-465e-af14-279e7838d2a3 with Priority: HIGHEST for action security_group_members [ 1212.983278] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c26daa-d251-465e-af14-279e7838d2a3 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.983278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.983278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.986135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.986135] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.986135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.986135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.986135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.986135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.986135] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c26daa-d251-465e-af14-279e7838d2a3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.491157] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.491315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.491315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.491707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.491830] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.492142] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.492351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.492481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.492787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.492925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.493142] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c26daa-d251-465e-af14-279e7838d2a3 is going to be updated. [ 1213.526877] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.526877] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.526877] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.527197] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.527275] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.537075] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c26daa-d251-465e-af14-279e7838d2a3 in Status: IN_PROGRESS for 2s [ 1214.065224] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1214.065530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.065653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.065871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.066155] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.066266] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.066306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.067023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.067023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.067023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.067023] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.360902] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.361191] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.361269] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.361541] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.361821] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.362022] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.362138] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.362449] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.362602] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.362815] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1214.362937] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1214.363070] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1214.363184] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1214.363306] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1214.363418] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1214.363567] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1214.391670] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1214.391865] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1214.391865] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1214.392064] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-228" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.392520] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.392708] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.392848] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.393147] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.393292] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b5b909b-b28a-42bf-ad8f-3dd0e7df6811',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.569328] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.569593] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.569676] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.570015] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.570294] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.570455] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.570564] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.570809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.570946] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.571123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.571374] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.571525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.571628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.571852] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.572088] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.572278] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.572368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.572581] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.572725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.572868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.572997] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.896027] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.896279] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.896408] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.896722] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.896889] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.897200] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.897361] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.897671] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.897952] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.898120] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.898416] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.898590] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.898737] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.898955] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.899108] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.899254] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 is going to be updated. [ 1214.920016] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.920243] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.920369] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.920640] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.920839] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.921096] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.069811] env[65102]: INFO networking_nsxv3.common.synchronization [req-1addffe1-0fb1-4c45-bc98-b892bd1abfc6 req-c6c8a5ec-8fb8-4f29-bd9f-d94f789a7e24 tempest-ServerActionsTestJSON-273915797 tempest-ServerActionsTestJSON-273915797-project-member] Enqueued Resource ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 with Priority: HIGHEST for action security_group_members [ 1215.070513] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 with Priority: HIGHEST for action security_group_members [ 1215.070791] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.071022] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.071086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.071293] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.071490] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.071631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.071699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.071958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.072112] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.072234] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4374bed5-fea3-4dd3-b7b5-66b0f19f6284',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.075622] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e8746f52-1411-469d-8df9-8b15536649f6: rpc.has_security_group_logging(os_id): False [ 1215.102835] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.103065] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.103114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.103316] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.103449] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.103637] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.103708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.103759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.103916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.103997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.104228] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.104446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.104548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.104662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.104742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.104947] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.105057] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.105127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.105263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.105400] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.105458] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1215.184223] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.184465] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.184522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.184759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.184956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.203762] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1215.547872] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c26daa-d251-465e-af14-279e7838d2a3 in Status: SUCCESS [ 1215.548085] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c26daa-d251-465e-af14-279e7838d2a3 deletion is rescheduled due to dependency. [ 1215.548208] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.575829] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.575829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.575829] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.576578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.576578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.576578] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.576578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.576578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.576578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.576784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.576784] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 is going to be updated. [ 1215.609715] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.609834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.609916] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.610188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.610372] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.620193] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 in Status: IN_PROGRESS for 2s [ 1215.643660] env[65102]: INFO networking_nsxv3.common.synchronization [req-b70add2c-9bc7-41c5-ae08-c7feea5bc021 req-b85fbdc7-5467-4572-bf31-55e7cecbab41 service nova] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_rules [ 1215.643855] env[65102]: INFO networking_nsxv3.common.synchronization [req-b70add2c-9bc7-41c5-ae08-c7feea5bc021 req-b85fbdc7-5467-4572-bf31-55e7cecbab41 service nova] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 1215.644017] env[65102]: INFO networking_nsxv3.common.synchronization [req-b70add2c-9bc7-41c5-ae08-c7feea5bc021 req-b85fbdc7-5467-4572-bf31-55e7cecbab41 service nova] Enqueued Resource ID: 4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 with Priority: HIGHEST for action port [ 1215.644622] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_rules [ 1215.644761] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 1215.644872] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 with Priority: HIGHEST for action port [ 1215.645180] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.645322] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.645388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.645616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.645704] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.646703] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.646808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.646808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.647100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.647212] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.647265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.647308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.648011] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.648011] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.648011] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.650119] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.650231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.650381] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.651775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.651775] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b5b909b-b28a-42bf-ad8f-3dd0e7df6811',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.153594] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.153896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.153956] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.154981] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 with status ACTIVE [ 1216.155335] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.155335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.155436] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.155609] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.155712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.155892] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.156009] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.156074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.156233] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.157034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.157034] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.157034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.157034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.157034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.157034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.157034] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b5b909b-b28a-42bf-ad8f-3dd0e7df6811 is going to be updated. [ 1216.180506] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.180678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.180848] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.181152] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.181407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.181662] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b5b909b-b28a-42bf-ad8f-3dd0e7df6811" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.659422] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.162581] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.162988] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.162988] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.163114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.163245] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.163381] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be updated. [ 1217.196539] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.196741] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.196808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.197067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.197263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.206956] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: IN_PROGRESS for 2s [ 1217.220795] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1217.221084] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.628497] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-198 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.628766] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-198" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.628923] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-198" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.629222] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-198" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.629486] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.629644] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.629761] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.629985] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.630231] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.630406] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1217.630521] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1217.630634] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1217.630738] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1217.630845] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1217.630948] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1217.631092] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1217.632655] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 in Status: SUCCESS [ 1217.632819] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 deletion is rescheduled due to dependency. [ 1217.632918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.650804] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1217.650968] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1217.651135] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1217.651312] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-198" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.651625] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-e48b19c2-6253-4a9c-a6fb-1daae3460ede taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.651798] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.651920] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.652191] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.652433] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e48b19c2-6253-4a9c-a6fb-1daae3460ede',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.155938] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.156107] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.156185] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.156469] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.156625] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.157035] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.157324] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.157511] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.157915] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.158891] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.159370] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.159553] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.159826] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.160130] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.160284] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.160438] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: e48b19c2-6253-4a9c-a6fb-1daae3460ede is going to be updated. [ 1218.180568] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.181054] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.181054] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.181186] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.181381] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.181604] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.896020] env[65102]: INFO networking_nsxv3.common.synchronization [req-4e014fe2-4ec9-447a-bc9f-602578e0c181 req-d368abb6-ac45-45d7-84df-bfb6eafd831d service nova] Enqueued Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_rules [ 1218.896020] env[65102]: INFO networking_nsxv3.common.synchronization [req-4e014fe2-4ec9-447a-bc9f-602578e0c181 req-d368abb6-ac45-45d7-84df-bfb6eafd831d service nova] Enqueued Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_members [ 1218.896020] env[65102]: INFO networking_nsxv3.common.synchronization [req-4e014fe2-4ec9-447a-bc9f-602578e0c181 req-d368abb6-ac45-45d7-84df-bfb6eafd831d service nova] Enqueued Resource ID: e48b19c2-6253-4a9c-a6fb-1daae3460ede with Priority: HIGHEST for action port [ 1218.896020] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_rules [ 1218.896020] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_members [ 1218.896020] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e48b19c2-6253-4a9c-a6fb-1daae3460ede with Priority: HIGHEST for action port [ 1218.896619] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.896984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.897197] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.897574] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.901092] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.901092] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.901092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.901092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.901092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.901092] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.901092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.901092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.901092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.901092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.901092] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.901092] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-e48b19c2-6253-4a9c-a6fb-1daae3460ede taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.901092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.901092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.901092] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.901970] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e48b19c2-6253-4a9c-a6fb-1daae3460ede',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.218414] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 1219.218893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.218893] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.219066] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.219265] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.219395] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.219457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.219623] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.219712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.219816] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.219865] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.403805] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.403946] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.404183] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.405310] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e48b19c2-6253-4a9c-a6fb-1daae3460ede with status ACTIVE [ 1219.405561] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.405716] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.405797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.406102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.406177] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.406423] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.406668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.406668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.407707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.407707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.407707] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.407707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.407707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.407707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.407707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.408082] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e48b19c2-6253-4a9c-a6fb-1daae3460ede is going to be updated. [ 1219.436325] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.436560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.436652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.436875] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.436971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.437161] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e48b19c2-6253-4a9c-a6fb-1daae3460ede" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.724204] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.910042] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.230325] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0212d5d1-3785-49e1-b4e8-aaad4f538d18: rpc.has_security_group_logging(os_id): False [ 1220.251207] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.251378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.251467] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.251714] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.251823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.252121] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.252250] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.252314] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.252494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.252593] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.252687] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be updated. [ 1220.342059] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.342059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.342059] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.342240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.342398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.360273] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: IN_PROGRESS for 2s [ 1220.412105] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.412296] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.412533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.412813] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.413103] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.413210] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 is going to be updated. [ 1220.462891] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.463140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.463140] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.463557] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.463557] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.476789] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: IN_PROGRESS for 2s [ 1222.377197] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 1222.377515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.487736] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: SUCCESS [ 1222.487901] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.487957] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.488219] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.488521] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.488635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.488635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.488773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.488856] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.489069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.489069] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.992114] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.992407] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.992514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.992812] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.993120] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.994151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.994456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.994880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.995061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.995366] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.995726] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.995983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.996239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.996527] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.996841] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.997129] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.997261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.997520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.997673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.997840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.998108] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.262131] env[65102]: INFO networking_nsxv3.common.synchronization [req-01ce275f-768e-4460-8345-2f0de2134c1c req-d4030963-a00b-4594-b008-0b8fe75d14ff tempest-ServersTestJSON-191426844 tempest-ServersTestJSON-191426844-project-member] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1223.262131] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1223.262131] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.262131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.262131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.262131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.262131] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.262131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.262131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.262131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.262131] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.262131] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.501087] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e9c3133-b79e-4eb2-8ba0-d484113ac747: rpc.has_security_group_logging(os_id): False [ 1223.523601] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.523807] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.523914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.524261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.524470] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.524681] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.524821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.524925] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.525189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.525328] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.525578] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.525671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.525740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.525908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.526062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.526375] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.526514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.526566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.526742] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.526818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.526945] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 is going to be updated. [ 1223.607613] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.607898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.607898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.608072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.608269] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.625126] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: IN_PROGRESS for 2s [ 1223.764486] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.266804] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.769456] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.769796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.769796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.769880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.769973] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.770086] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1224.801725] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.801725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.801725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.801725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.801725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.811989] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1225.641100] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: SUCCESS [ 1225.641346] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.822220] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1226.822563] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.260989] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1228.261427] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1229.905475] env[65102]: INFO networking_nsxv3.common.synchronization [req-be374a88-a100-4b81-ae5c-6e9e4803980a req-dc844ce6-3fed-49a5-8f73-9825418f1c96 tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 with Priority: HIGHEST for action security_group_members [ 1229.906370] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 with Priority: HIGHEST for action security_group_members [ 1229.906519] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-642eb2e5-acd8-44f5-87bb-521553cbd5e2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.906601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.907076] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.907076] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.907076] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.907241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.907241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.907320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.907810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.907810] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('642eb2e5-acd8-44f5-87bb-521553cbd5e2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.351086] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-500 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.351327] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.351430] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.351705] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.352426] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.352599] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.352732] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.352966] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.353159] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.353379] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1230.353493] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1230.353601] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1230.353706] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1230.353813] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1230.353914] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1230.354055] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1230.377914] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1230.378349] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1230.378349] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1230.378448] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-500" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.378753] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.378974] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.379064] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.379325] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.379508] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72f482ac-0a93-4cf4-9d54-a7e812ca4cd9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.409816] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.410051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.410051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.410363] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.410478] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.410679] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.410776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.410840] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.410994] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.411135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.411226] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 is going to be updated. [ 1230.441605] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.441817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.441886] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.442096] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.442215] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.452062] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 in Status: IN_PROGRESS for 2s [ 1230.881556] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.881897] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.881897] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.882249] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.882426] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.882706] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.882869] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.883085] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.883281] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.883389] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.883705] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.883913] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.884047] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.884292] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.884431] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.884615] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 is going to be updated. [ 1230.911860] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.911860] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.911860] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.911860] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.911860] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.912587] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.641616] env[65102]: INFO networking_nsxv3.common.synchronization [req-62c0fc75-43c4-4e4f-b82d-7965e578b1cd req-eb240ae1-f25b-4726-8f24-efc6a9ed1815 service nova] Enqueued Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_rules [ 1231.641691] env[65102]: INFO networking_nsxv3.common.synchronization [req-62c0fc75-43c4-4e4f-b82d-7965e578b1cd req-eb240ae1-f25b-4726-8f24-efc6a9ed1815 service nova] Enqueued Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_members [ 1231.641790] env[65102]: INFO networking_nsxv3.common.synchronization [req-62c0fc75-43c4-4e4f-b82d-7965e578b1cd req-eb240ae1-f25b-4726-8f24-efc6a9ed1815 service nova] Enqueued Resource ID: 72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 with Priority: HIGHEST for action port [ 1231.642642] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_rules [ 1231.642642] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_members [ 1231.642642] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 with Priority: HIGHEST for action port [ 1231.643352] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0807565d-e6cc-4e93-b299-cd44c8892eaa taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.643352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.643352] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.643899] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.643899] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.644710] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0807565d-e6cc-4e93-b299-cd44c8892eaa taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.644832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.644894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.645081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.645292] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.645393] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.645454] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.645601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.645687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.645778] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.646913] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.646913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.646913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.647546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.647546] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72f482ac-0a93-4cf4-9d54-a7e812ca4cd9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.149728] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0807565d-e6cc-4e93-b299-cd44c8892eaa taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.149728] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.150191] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.151049] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 with status ACTIVE [ 1232.151313] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.151508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.151616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.151867] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.152015] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.154826] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.154826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.154826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.154826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.154826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.154826] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.154826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.154826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.154826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.154826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.154826] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72f482ac-0a93-4cf4-9d54-a7e812ca4cd9 is going to be updated. [ 1232.176474] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.176621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.176682] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.176878] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.177029] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.177191] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72f482ac-0a93-4cf4-9d54-a7e812ca4cd9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.463847] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 in Status: SUCCESS [ 1232.464038] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 deletion is rescheduled due to dependency. [ 1232.464161] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.657040] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.160072] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.160475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.160475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.160566] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.160601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.160689] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa is going to be updated. [ 1233.196313] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.196471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.196544] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.196761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.196903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.207283] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa in Status: IN_PROGRESS for 2s [ 1235.221277] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa in Status: SUCCESS [ 1235.221277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.221277] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.221702] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.221743] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.221897] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.221984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.222201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.222601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.222779] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.222910] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.718165] env[65102]: INFO networking_nsxv3.common.synchronization [req-f4cfb28e-88f5-4a8a-939b-3de4a6ea6687 req-cc293bb0-2bd5-455c-bc5c-e4fe328a82cb tempest-ServerActionsTestOtherB-1046242315 tempest-ServerActionsTestOtherB-1046242315-project-member] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 1235.718774] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGHEST for action security_group_members [ 1235.719107] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.719236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.719297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.719546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.719763] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.719763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.719938] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.720179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.720179] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.720336] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.726341] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.851906] env[65102]: INFO networking_nsxv3.common.synchronization [req-39646651-c6e0-46e4-8bce-734cca67e86a req-7218b4ee-dd81-46a2-9eda-e25cb0925891 tempest-ServersTestJSON-191426844 tempest-ServersTestJSON-191426844-project-member] Enqueued Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1235.852218] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8746f52-1411-469d-8df9-8b15536649f6 with Priority: HIGHEST for action security_group_members [ 1235.852892] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-e8746f52-1411-469d-8df9-8b15536649f6 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.853028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.853103] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.854048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.854048] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.854048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.854048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.854048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.854048] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.854048] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e8746f52-1411-469d-8df9-8b15536649f6',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.227407] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.227788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.227788] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.227888] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.228060] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.228817] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.228817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.228817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.228817] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.229069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.229069] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be updated. [ 1236.230644] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0807565d-e6cc-4e93-b299-cd44c8892eaa: rpc.has_security_group_logging(os_id): False [ 1236.252389] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.252658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.252658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.253625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.253625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.253625] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.253625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.253625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.253625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.253625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.254064] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa is going to be updated. [ 1236.263582] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.263921] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.263921] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.264086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.264295] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.276731] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: IN_PROGRESS for 2s [ 1236.324780] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.324996] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.325064] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.325336] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.325546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.341039] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa in Status: IN_PROGRESS for 2s [ 1236.356658] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.356832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.356896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.357301] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.357301] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.357467] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.357583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.357643] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.357781] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.357903] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.358047] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 is going to be updated. [ 1236.391403] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.391591] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.391632] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.391821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.391964] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.403570] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: IN_PROGRESS for 2s [ 1238.295258] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 in Status: SUCCESS [ 1238.295531] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 deletion is rescheduled due to dependency. [ 1238.295531] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.356254] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa in Status: SUCCESS [ 1238.356485] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.413404] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e8746f52-1411-469d-8df9-8b15536649f6 in Status: SUCCESS [ 1238.413614] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e8746f52-1411-469d-8df9-8b15536649f6 deletion is rescheduled due to dependency. [ 1238.413749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e8746f52-1411-469d-8df9-8b15536649f6" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.860445] env[65102]: INFO networking_nsxv3.common.synchronization [req-d934f55a-bf73-46eb-ba01-38e68275b87f req-ae2e2e1a-dc35-432c-97fb-87a0637daa84 tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_members [ 1239.860993] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_members [ 1239.861351] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.861456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.861515] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.861695] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.861848] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.861947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.862021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.862168] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.862261] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.862418] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.294084] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.294527] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.294771] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.295199] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.295641] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.295909] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.296130] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.296499] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.296781] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.297146] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1240.297342] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1240.297538] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1240.297733] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1240.297937] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1240.298170] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1240.298408] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1240.337828] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1240.338085] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1240.338292] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1240.338554] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.339023] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-d4ef2ece-8832-4198-a869-6869223cf87a taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.339272] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-d4ef2ece-8832-4198-a869-6869223cf87a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.339442] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-d4ef2ece-8832-4198-a869-6869223cf87a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.339921] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-d4ef2ece-8832-4198-a869-6869223cf87a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.340150] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4ef2ece-8832-4198-a869-6869223cf87a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.364797] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.365062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.365062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.365273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.365364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.365666] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.365784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.365861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.366062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.366171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.366274] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b is going to be updated. [ 1240.401314] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.401606] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.401606] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.401744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.401892] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.413680] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b in Status: IN_PROGRESS for 2s [ 1240.844061] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.844061] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.844061] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.844061] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.844061] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.844459] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port d4ef2ece-8832-4198-a869-6869223cf87a not found, creating... [ 1240.844459] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.844632] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.844767] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.845039] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.845161] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.845460] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.845655] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.846291] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.846291] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.846291] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.846448] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: d4ef2ece-8832-4198-a869-6869223cf87a is going to be created. [ 1240.868805] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.869263] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.869263] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.869873] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.870097] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.870618] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-d4ef2ece-8832-4198-a869-6869223cf87a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.629173] env[65102]: INFO networking_nsxv3.common.synchronization [req-d934f55a-bf73-46eb-ba01-38e68275b87f req-5c54e211-fba0-41f7-90b6-0c36b596ef8e service nova] Enqueued Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_rules [ 1241.629366] env[65102]: INFO networking_nsxv3.common.synchronization [req-d934f55a-bf73-46eb-ba01-38e68275b87f req-5c54e211-fba0-41f7-90b6-0c36b596ef8e service nova] Enqueued Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_members [ 1241.629507] env[65102]: INFO networking_nsxv3.common.synchronization [req-d934f55a-bf73-46eb-ba01-38e68275b87f req-5c54e211-fba0-41f7-90b6-0c36b596ef8e service nova] Enqueued Resource ID: d4ef2ece-8832-4198-a869-6869223cf87a with Priority: HIGHEST for action port [ 1241.630448] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_rules [ 1241.630631] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_members [ 1241.630721] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ef2ece-8832-4198-a869-6869223cf87a with Priority: HIGHEST for action port [ 1241.631051] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.631181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.631337] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.631493] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.631546] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.632668] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.632668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.632872] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4ef2ece-8832-4198-a869-6869223cf87a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.632976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4ef2ece-8832-4198-a869-6869223cf87a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.633057] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4ef2ece-8832-4198-a869-6869223cf87a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.633291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4ef2ece-8832-4198-a869-6869223cf87a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.633346] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4ef2ece-8832-4198-a869-6869223cf87a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.135428] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.135937] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.135937] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4ef2ece-8832-4198-a869-6869223cf87a with status ACTIVE [ 1242.136168] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.136168] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.136683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.136683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.136683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.136842] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.136842] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.136960] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.137039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.137127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.137306] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.137401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.137458] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.137595] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.137672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.137749] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4ef2ece-8832-4198-a869-6869223cf87a is going to be updated. [ 1242.191447] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.191739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.191876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.192249] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.192477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.192827] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4ef2ece-8832-4198-a869-6869223cf87a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.434628] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b in Status: SUCCESS [ 1242.434628] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b deletion is rescheduled due to dependency. [ 1242.434628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.434628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.434940] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.434940] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.435125] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.435216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.435399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.435499] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.435645] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.938436] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.445409] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.947254] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.947479] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.947608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.947905] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.948512] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.948512] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b is going to be updated. [ 1243.981712] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.981885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.981958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.982271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.983362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.992649] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b in Status: IN_PROGRESS for 2s [ 1246.004757] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b in Status: SUCCESS [ 1246.005146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.005146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.005378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.005584] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.005706] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.005773] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.005944] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.006067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.006128] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.006222] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.508879] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.508879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.508879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.509184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.509184] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.509340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.509340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.509425] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.509513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.509601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.509745] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.509836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.509897] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.510331] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.510477] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.510574] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.510634] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.510766] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.510842] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.510924] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.511026] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.632169] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1246.632169] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1247.013749] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a03dedcf-91ec-46f5-b008-cad3f9c1d50b: rpc.has_security_group_logging(os_id): False [ 1247.031552] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.031717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.031796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.032087] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.032185] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.032420] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.032568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.032637] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.032801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.032879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.033098] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.033197] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.033260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.033400] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.033475] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.033665] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.033759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.033820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.033958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.034049] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.034136] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b is going to be updated. [ 1247.102742] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.102953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.102953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.103180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.103333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.119127] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b in Status: IN_PROGRESS for 2s [ 1249.133754] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b in Status: SUCCESS [ 1249.134019] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.986116] env[65102]: INFO networking_nsxv3.common.synchronization [req-2deca903-6f40-41f4-8e38-c09e8488ab5c req-44160d96-c217-48d5-9f40-1be2339533f4 tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_members [ 1249.987141] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGHEST for action security_group_members [ 1249.987141] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.987141] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.987364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.987401] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.987551] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.987650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.987713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.987857] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.987944] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.988047] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.029905] env[65102]: INFO networking_nsxv3.common.synchronization [req-2deca903-6f40-41f4-8e38-c09e8488ab5c req-44160d96-c217-48d5-9f40-1be2339533f4 tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: d4ef2ece-8832-4198-a869-6869223cf87a with Priority: HIGHEST for action port [ 1250.030699] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4ef2ece-8832-4198-a869-6869223cf87a with Priority: HIGHEST for action port [ 1250.031131] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4ef2ece-8832-4198-a869-6869223cf87a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.031310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4ef2ece-8832-4198-a869-6869223cf87a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.031418] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4ef2ece-8832-4198-a869-6869223cf87a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.031660] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4ef2ece-8832-4198-a869-6869223cf87a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.031788] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4ef2ece-8832-4198-a869-6869223cf87a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.234526] env[65102]: INFO networking_nsxv3.common.synchronization [req-eee918f7-cab3-4dde-a03b-cf938e076c9c req-1489e305-d3f2-4fb8-a312-364f6e5f3162 tempest-ServersNegativeTestJSON-56640959 tempest-ServersNegativeTestJSON-56640959-project-member] Enqueued Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_members [ 1250.235131] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 with Priority: HIGHEST for action security_group_members [ 1250.235473] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e9c3133-b79e-4eb2-8ba0-d484113ac747 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.235664] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.235772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.235994] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.236827] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.237027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.237027] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.237712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.237712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.237712] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e9c3133-b79e-4eb2-8ba0-d484113ac747',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.253561] env[65102]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1250.253700] env[65102]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-b322a8d1-0a71-49e1-bc6f-5c3a27944d79 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1250.490304] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.490506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.490564] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.490802] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.490927] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.491205] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.491325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.491378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.491507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.491604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.491697] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b is going to be updated. [ 1250.522017] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.522267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.522853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.523038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.523205] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.533917] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b in Status: IN_PROGRESS for 2s [ 1250.534538] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4ef2ece-8832-4198-a869-6869223cf87a with status ACTIVE [ 1250.534770] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.534918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.535036] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.535243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.535310] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.535527] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.535690] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.535763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.535866] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.535954] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.536184] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.536282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.536344] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.536484] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.536560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.536644] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4ef2ece-8832-4198-a869-6869223cf87a is going to be updated. [ 1250.560410] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.560652] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.560756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.561033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.561258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.561445] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4ef2ece-8832-4198-a869-6869223cf87a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.740517] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.740750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.740810] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.741028] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.741132] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.741332] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.741432] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.741496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.741669] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.741736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.742048] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 is going to be updated. [ 1250.776795] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.776958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.777063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.777403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.777580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.786970] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: IN_PROGRESS for 2s [ 1251.816064] env[65102]: INFO networking_nsxv3.common.synchronization [req-a1e449e5-6650-41fb-b765-c3fd2e7dfb25 req-3b63c062-2644-4b55-9fbb-eb6580a2afed tempest-ServerActionsTestJSON-273915797 tempest-ServerActionsTestJSON-273915797-project-member] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 1251.816641] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 1251.817265] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.817403] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.817469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.817671] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.817875] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.818034] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.818074] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.818214] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.818290] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.818385] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.320147] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.320353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.320424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.320670] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.320772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.321054] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.321165] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.321247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.321459] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.321519] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.321618] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b is going to be updated. [ 1252.357777] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.357961] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.358070] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.358258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.358400] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.367960] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: IN_PROGRESS for 2s [ 1252.544085] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b in Status: SUCCESS [ 1252.544291] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b deletion is rescheduled due to dependency. [ 1252.544395] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.796576] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 in Status: SUCCESS [ 1252.796795] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e9c3133-b79e-4eb2-8ba0-d484113ac747 deletion is rescheduled due to dependency. [ 1252.796880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e9c3133-b79e-4eb2-8ba0-d484113ac747" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.395932] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: SUCCESS [ 1254.396368] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b deletion is rescheduled due to dependency. [ 1254.396368] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.818362] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1256.818748] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1258.925044] env[65102]: INFO networking_nsxv3.common.synchronization [req-ae60e9a8-4dd1-4210-b8ee-75fc77d11d94 req-88886c62-96c6-4876-8c9d-413135e9accf tempest-ServerActionsTestJSON-273915797 tempest-ServerActionsTestJSON-273915797-project-member] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 1258.925044] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 1258.925633] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.925633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.925633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.925772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.925849] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.925951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.926035] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.926193] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.926546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.926546] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.200978] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.201216] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.201341] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.201600] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.201855] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.202015] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.202133] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.202353] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.202512] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.202781] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1259.202900] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1259.203024] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1259.203135] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1259.203248] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1259.203353] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1259.203489] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1259.223180] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1259.223333] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1259.223466] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1259.223637] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.223939] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-ff8925f6-fab7-49a5-bae0-493ec802effc taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.224119] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-ff8925f6-fab7-49a5-bae0-493ec802effc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.224239] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-ff8925f6-fab7-49a5-bae0-493ec802effc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.224546] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-ff8925f6-fab7-49a5-bae0-493ec802effc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.224769] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff8925f6-fab7-49a5-bae0-493ec802effc',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.428771] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.428976] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.429041] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.429243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.429335] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.429540] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.429641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.429704] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.429859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.429933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.430041] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b is going to be updated. [ 1259.457607] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.457764] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.457824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.458039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.458189] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.466419] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: IN_PROGRESS for 2s [ 1259.727484] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.727683] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.727819] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.728131] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.728286] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.728440] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port ff8925f6-fab7-49a5-bae0-493ec802effc not found, creating... [ 1259.728697] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.728856] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.728973] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.729210] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.729349] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.729633] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.729791] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.729909] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.730137] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.730272] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.730412] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: ff8925f6-fab7-49a5-bae0-493ec802effc is going to be created. [ 1259.758194] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.758443] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.758507] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.758757] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.758982] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.759220] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-ff8925f6-fab7-49a5-bae0-493ec802effc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.459460] env[65102]: INFO networking_nsxv3.common.synchronization [req-ae60e9a8-4dd1-4210-b8ee-75fc77d11d94 req-34f62dd1-eb4a-4e92-8830-bc4088bb0ff1 service nova] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_rules [ 1260.459767] env[65102]: INFO networking_nsxv3.common.synchronization [req-ae60e9a8-4dd1-4210-b8ee-75fc77d11d94 req-34f62dd1-eb4a-4e92-8830-bc4088bb0ff1 service nova] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 1260.459767] env[65102]: INFO networking_nsxv3.common.synchronization [req-ae60e9a8-4dd1-4210-b8ee-75fc77d11d94 req-34f62dd1-eb4a-4e92-8830-bc4088bb0ff1 service nova] Enqueued Resource ID: ff8925f6-fab7-49a5-bae0-493ec802effc with Priority: HIGHEST for action port [ 1260.460295] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_rules [ 1260.460435] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 1260.460575] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff8925f6-fab7-49a5-bae0-493ec802effc with Priority: HIGHEST for action port [ 1260.460890] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.461039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.461110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.461328] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.461454] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.463418] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.463536] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.464444] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff8925f6-fab7-49a5-bae0-493ec802effc taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.464444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff8925f6-fab7-49a5-bae0-493ec802effc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.464444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff8925f6-fab7-49a5-bae0-493ec802effc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.464444] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff8925f6-fab7-49a5-bae0-493ec802effc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.464444] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff8925f6-fab7-49a5-bae0-493ec802effc',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.964137] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.964303] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.967094] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff8925f6-fab7-49a5-bae0-493ec802effc with status ACTIVE [ 1260.967094] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.967216] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.967297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.967531] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.967630] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.968103] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.968103] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.968103] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.968263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.968263] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.968434] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.968529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.968604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.968743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.968833] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.968919] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff8925f6-fab7-49a5-bae0-493ec802effc is going to be updated. [ 1260.991541] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.991753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.991753] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.991975] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.992144] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.992320] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff8925f6-fab7-49a5-bae0-493ec802effc" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.532083] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: SUCCESS [ 1261.532083] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b deletion is rescheduled due to dependency. [ 1261.532083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.532083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.532083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.532083] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.532083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.532083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.532083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.532083] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.532083] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.981899] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.484071] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.986592] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.986981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.986981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.987165] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.987294] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.987406] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b is going to be updated. [ 1263.016575] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.017463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.017463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.017463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.017463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.026554] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: IN_PROGRESS for 2s [ 1265.042883] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: SUCCESS [ 1265.043306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.043306] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.043529] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.043756] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.044246] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.044246] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.044246] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.044246] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.044522] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.044522] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.461302] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1265.461512] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1265.547234] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.049696] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29d98990-b866-4c6c-b1d9-41effdf1076b: rpc.has_security_group_logging(os_id): False [ 1266.067435] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.067672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.067672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.067832] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.067922] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.068176] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.068276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.068340] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.068495] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.068580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.068700] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b is going to be updated. [ 1266.126264] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.126482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.126482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.126744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.126910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.137673] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: IN_PROGRESS for 2s [ 1268.151482] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: SUCCESS [ 1268.151889] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.461942] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.463810] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1274.507051] env[65102]: INFO networking_nsxv3.common.synchronization [req-75ad3ae7-6033-474a-96c3-993acea5790a req-c0cbcb12-d04e-4d7f-b648-59439861f44d tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_members [ 1274.507603] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_members [ 1274.507951] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.508094] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.508159] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.508355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.508511] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.508610] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.508668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.508809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.508898] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.509065] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.768906] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-820 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.769160] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.769272] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.769547] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.770215] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.770421] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.770549] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.770786] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.770936] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.771169] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.771286] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.771394] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.771503] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.771612] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.771718] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.771851] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.792050] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.792259] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1274.792394] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.792567] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-820" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.792919] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-30bb95a2-1900-433c-98bc-b8436565a0ff taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.793125] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-30bb95a2-1900-433c-98bc-b8436565a0ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.793249] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-30bb95a2-1900-433c-98bc-b8436565a0ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.793559] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-30bb95a2-1900-433c-98bc-b8436565a0ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.793695] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30bb95a2-1900-433c-98bc-b8436565a0ff',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.011237] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.296332] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.296607] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.296768] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.297144] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.297342] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.297511] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 30bb95a2-1900-433c-98bc-b8436565a0ff not found, creating... [ 1275.297815] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.298016] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.298160] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.298417] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.298558] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.298840] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.298994] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.299127] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.299329] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.299459] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.299596] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 30bb95a2-1900-433c-98bc-b8436565a0ff is going to be created. [ 1275.319269] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.319471] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.319586] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.319805] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.320044] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.320284] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-30bb95a2-1900-433c-98bc-b8436565a0ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.515298] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.001906] env[65102]: INFO networking_nsxv3.common.synchronization [req-75ad3ae7-6033-474a-96c3-993acea5790a req-625b7440-048a-484d-9a3c-dcdcbc244beb service nova] Enqueued Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_rules [ 1276.002401] env[65102]: INFO networking_nsxv3.common.synchronization [req-75ad3ae7-6033-474a-96c3-993acea5790a req-625b7440-048a-484d-9a3c-dcdcbc244beb service nova] Enqueued Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_members [ 1276.002401] env[65102]: INFO networking_nsxv3.common.synchronization [req-75ad3ae7-6033-474a-96c3-993acea5790a req-625b7440-048a-484d-9a3c-dcdcbc244beb service nova] Enqueued Resource ID: 30bb95a2-1900-433c-98bc-b8436565a0ff with Priority: HIGHEST for action port [ 1276.002885] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_rules [ 1276.003082] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_members [ 1276.003209] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30bb95a2-1900-433c-98bc-b8436565a0ff with Priority: HIGHEST for action port [ 1276.003493] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.003618] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.003683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.003884] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.003970] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.004898] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.004997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.005220] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-30bb95a2-1900-433c-98bc-b8436565a0ff taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.005324] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30bb95a2-1900-433c-98bc-b8436565a0ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.005388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30bb95a2-1900-433c-98bc-b8436565a0ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.005568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30bb95a2-1900-433c-98bc-b8436565a0ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.005645] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30bb95a2-1900-433c-98bc-b8436565a0ff',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.016784] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.017086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.017181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.017476] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.017602] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.017800] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 is going to be updated. [ 1276.048553] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.048861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.048861] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.048958] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.049121] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.057997] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: IN_PROGRESS for 2s [ 1276.507919] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.508122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.508389] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30bb95a2-1900-433c-98bc-b8436565a0ff with status ACTIVE [ 1276.508624] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.508777] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.508910] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.509180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.509305] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.509536] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.509678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.509778] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.510014] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.510099] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.510745] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.510745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.510745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.510745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.510940] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.511032] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30bb95a2-1900-433c-98bc-b8436565a0ff is going to be updated. [ 1276.544082] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.544082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.544082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.544082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.544082] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.544663] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30bb95a2-1900-433c-98bc-b8436565a0ff" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.070937] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: SUCCESS [ 1278.071456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.071456] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.071580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.071782] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.071912] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.071998] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.072151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.072238] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.072332] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.574343] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.077577] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.580325] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.580548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.580548] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.580755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.580843] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.580945] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 is going to be updated. [ 1279.638384] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.638592] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.638592] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.638735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.638880] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.650473] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: IN_PROGRESS for 2s [ 1281.005673] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1281.006023] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1281.661921] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: SUCCESS [ 1281.662271] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.662508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.662744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.662944] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.663114] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.663164] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.663294] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.663374] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.663458] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.663549] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.166900] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.669132] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9b36c7e-229d-48ea-b61f-94b35a51b7f4: rpc.has_security_group_logging(os_id): False [ 1282.690372] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.690721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.690721] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.691180] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.716276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.716525] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.716649] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.716717] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.716929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.717020] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.717143] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 is going to be updated. [ 1282.783642] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.783886] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.783886] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.784117] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.784227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.797107] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: IN_PROGRESS for 2s [ 1284.812020] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: SUCCESS [ 1284.812410] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.006755] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1286.007175] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1287.564857] env[65102]: INFO networking_nsxv3.common.synchronization [req-fe1514ca-8240-4805-bf97-03dba651c254 req-9809cb25-90c4-44a7-a496-35f1f0ef99c1 tempest-AttachVolumeShelveTestJSON-733143698 tempest-AttachVolumeShelveTestJSON-733143698-project-member] Enqueued Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_members [ 1287.565479] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGHEST for action security_group_members [ 1287.565793] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-0807565d-e6cc-4e93-b299-cd44c8892eaa taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.565933] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.566023] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.566223] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.566480] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.566480] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.566590] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.566665] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.566749] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.566842] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.069105] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.069338] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.069338] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.069513] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.069608] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.069815] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.069920] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.069984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.070149] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.070227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.070313] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa is going to be updated. [ 1288.099808] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.100056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.100056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.100247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.100399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.109553] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa in Status: IN_PROGRESS for 2s [ 1290.122039] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa in Status: SUCCESS [ 1290.122531] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa deletion is rescheduled due to dependency. [ 1290.122531] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.566609] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1292.566931] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1294.169872] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.170339] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.170339] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.170339] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.170477] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.672549] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.174799] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.677429] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1295.677602] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1296.502606] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.503063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.503063] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.503218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.516633] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1296.517446] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.518954] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1296.554089] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.554302] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.554302] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.554598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.569571] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.570376] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1296.570459] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.570551] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1296.607911] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.608218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.608378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.608707] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.610509] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.610785] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1296.686404] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.686661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.686661] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.686868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.687440] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.687761] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1296.766710] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.766953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.766953] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.767184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.767553] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.767898] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 1296.767986] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0212d5d1-3785-49e1-b4e8-aaad4f538d18', '43c26daa-d251-465e-af14-279e7838d2a3', 'be29eb73-d99e-4af1-ad2e-c5ce871f7807', 'd17fda10-7148-4558-b429-6c6b75b5f20d', 'b4501856-910f-4bf4-9fd2-4d3675738a94', '29d98990-b866-4c6c-b1d9-41effdf1076b', '59c26ae1-e2ae-453d-a285-e702cf89832f', '29e1de56-440c-4328-94fb-d8f682a71bad', '642eb2e5-acd8-44f5-87bb-521553cbd5e2', '0807565d-e6cc-4e93-b299-cd44c8892eaa', 'a03dedcf-91ec-46f5-b008-cad3f9c1d50b', '1e4d0983-93de-4906-b7b5-69591bafe0fd', '4374bed5-fea3-4dd3-b7b5-66b0f19f6284', '085dab98-e474-491b-84c3-9542fcfa6775', 'ad9e53d9-a7e1-4764-bc44-f35fa2308feb', '6a0c01bc-dc67-4824-bf8b-60c7f41f292f', '0c61af5d-d112-491b-97cd-9e037a2e5189', 'c0f8a62e-96a1-4434-a694-20df67619d3c', 'bd79c243-92bc-47a2-80ad-114091c4bab9', 'd9b36c7e-229d-48ea-b61f-94b35a51b7f4', 'e683108f-84a0-4d62-934c-58f2999656a4', 'da64d8cd-1e23-4ba6-bed1-a5337d6e1da4', 'c6a41d40-0a8b-401c-801a-f31f69ae007f', '01880e80-b093-4590-b2d1-b15567f49135', 'c1b926d4-3a35-4d53-823e-1d4fbac254ef', 'b55ab5c0-f0c2-4178-85f4-c461e1efe368', '5476d54c-8894-4aeb-b26c-f1637341e27f', '3e9c3133-b79e-4eb2-8ba0-d484113ac747', '99c8f96e-2cdb-49cd-8847-bf7698ff539f', '2c6cdc2b-9511-477a-8ea2-7f547770beda', '5e0a8011-b557-40dd-b9b5-481c08d0040a', '48a0698b-8c00-4295-9ba0-bc4c6ebdca57', 'daef1b5a-f25a-405c-9f5a-58444ec5510f', 'a0bc7ffe-997e-4e93-849d-b293c0ee0e6a', 'a6a6e2c1-d834-4eaf-b515-26c83f090350', '082ce940-517e-4ecd-a42e-d7d185e47139', 'cef9ee3d-68cd-4411-ad09-df35823eb076', '220505b1-a182-4b77-b78e-66a35b312ba6', 'e8746f52-1411-469d-8df9-8b15536649f6', '351e6bc8-ffc9-4dca-ac8a-98595980ddc4', '1966cd49-8e43-4ab8-862a-7f66af79660a'} {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.768154] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1296.827414] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.827663] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.827876] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.828818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.828818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.828818] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1296.828818] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.828818] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1296.921246] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.921730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.921730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.921844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.923357] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.923616] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1296.923699] env[65102]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65102) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1296.923774] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1296.923845] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1296.923951] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 1296.924059] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGH for action security_group_rules [ 1296.924174] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 43c26daa-d251-465e-af14-279e7838d2a3 with Priority: HIGH for action security_group_rules [ 1296.924281] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGH for action security_group_rules [ 1296.924315] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGH for action security_group_rules [ 1296.924376] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGH for action security_group_rules [ 1296.924424] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGH for action security_group_rules [ 1296.924571] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGH for action security_group_rules [ 1296.924571] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 29e1de56-440c-4328-94fb-d8f682a71bad with Priority: HIGH for action security_group_rules [ 1296.924659] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 with Priority: HIGH for action security_group_rules [ 1296.924659] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGH for action security_group_rules [ 1296.924753] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGH for action security_group_rules [ 1296.924753] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGH for action security_group_rules [ 1296.924921] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 with Priority: HIGH for action security_group_rules [ 1296.924921] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 085dab98-e474-491b-84c3-9542fcfa6775 with Priority: HIGH for action security_group_rules [ 1296.924921] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb with Priority: HIGH for action security_group_rules [ 1296.925205] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGH for action security_group_rules [ 1296.925205] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGH for action security_group_rules [ 1296.925205] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGH for action security_group_rules [ 1296.925297] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGH for action security_group_rules [ 1296.925297] env[65102]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGH for action security_group_rules [ 1296.925365] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.568076] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1297.568455] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1297.568455] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 with Priority: HIGH for action security_group_rules [ 1297.568567] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 with Priority: HIGH for action security_group_rules [ 1297.568618] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c26ae1-e2ae-453d-a285-e702cf89832f with Priority: HIGH for action security_group_rules [ 1297.568730] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb with Priority: HIGH for action security_group_rules [ 1297.568826] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGH for action security_group_rules [ 1297.568920] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd79c243-92bc-47a2-80ad-114091c4bab9 with Priority: HIGH for action security_group_rules [ 1297.569045] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f8a62e-96a1-4434-a694-20df67619d3c with Priority: HIGH for action security_group_rules [ 1297.569180] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 with Priority: HIGH for action security_group_rules [ 1297.569723] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 085dab98-e474-491b-84c3-9542fcfa6775 with Priority: HIGH for action security_group_rules [ 1297.569843] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f with Priority: HIGH for action security_group_rules [ 1297.569945] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 with Priority: HIGH for action security_group_rules [ 1297.570081] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd with Priority: HIGH for action security_group_rules [ 1297.570198] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b with Priority: HIGH for action security_group_rules [ 1297.570291] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa with Priority: HIGH for action security_group_rules [ 1297.570384] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 with Priority: HIGH for action security_group_rules [ 1297.570476] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGH for action security_group_rules [ 1297.570564] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29e1de56-440c-4328-94fb-d8f682a71bad with Priority: HIGH for action security_group_rules [ 1297.570654] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4501856-910f-4bf4-9fd2-4d3675738a94 with Priority: HIGH for action security_group_rules [ 1297.570741] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c26daa-d251-465e-af14-279e7838d2a3 with Priority: HIGH for action security_group_rules [ 1297.570830] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d17fda10-7148-4558-b429-6c6b75b5f20d with Priority: HIGH for action security_group_rules [ 1297.571194] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.571319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.571385] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.571614] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.571696] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0212d5d1-3785-49e1-b4e8-aaad4f538d18',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.572746] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.572864] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.572951] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.573142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.573222] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be29eb73-d99e-4af1-ad2e-c5ce871f7807',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.574043] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59c26ae1-e2ae-453d-a285-e702cf89832f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.574159] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.574225] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.574377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.574450] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59c26ae1-e2ae-453d-a285-e702cf89832f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.575232] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad9e53d9-a7e1-4764-bc44-f35fa2308feb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.575377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.575377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.575514] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.575580] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad9e53d9-a7e1-4764-bc44-f35fa2308feb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.576438] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.576585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.576585] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.576823] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.576823] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.577558] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd79c243-92bc-47a2-80ad-114091c4bab9 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.577688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.577688] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.577793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.577869] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd79c243-92bc-47a2-80ad-114091c4bab9',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.578564] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0f8a62e-96a1-4434-a694-20df67619d3c taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.578668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.578724] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.578871] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.578935] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0f8a62e-96a1-4434-a694-20df67619d3c',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.579660] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c61af5d-d112-491b-97cd-9e037a2e5189 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.579743] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.579845] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.579956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.580041] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c61af5d-d112-491b-97cd-9e037a2e5189',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.580808] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-085dab98-e474-491b-84c3-9542fcfa6775 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.580913] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.580985] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.581175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.581460] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('085dab98-e474-491b-84c3-9542fcfa6775',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.581909] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.582025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.582098] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.582276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.582276] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a0c01bc-dc67-4824-bf8b-60c7f41f292f',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.583156] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.583156] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.583156] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.583290] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.583384] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4374bed5-fea3-4dd3-b7b5-66b0f19f6284',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.583978] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e4d0983-93de-4906-b7b5-69591bafe0fd taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.584184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.584260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.584687] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.584687] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e4d0983-93de-4906-b7b5-69591bafe0fd',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.586488] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.586592] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.586650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.586794] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.586865] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a03dedcf-91ec-46f5-b008-cad3f9c1d50b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.587536] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0807565d-e6cc-4e93-b299-cd44c8892eaa taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.587635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.587763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.587842] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.587913] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0807565d-e6cc-4e93-b299-cd44c8892eaa',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.588602] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.588701] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.589414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.589414] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.589414] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('642eb2e5-acd8-44f5-87bb-521553cbd5e2',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.589706] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.589801] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.589865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.590062] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.590523] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.590988] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29e1de56-440c-4328-94fb-d8f682a71bad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.591487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.591487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.591487] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.591487] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29e1de56-440c-4328-94fb-d8f682a71bad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.592095] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4501856-910f-4bf4-9fd2-4d3675738a94 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.592149] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.592211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.592353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.592410] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4501856-910f-4bf4-9fd2-4d3675738a94',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.593102] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43c26daa-d251-465e-af14-279e7838d2a3 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.593209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.593275] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.593427] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.593482] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43c26daa-d251-465e-af14-279e7838d2a3',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.594343] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d17fda10-7148-4558-b429-6c6b75b5f20d taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.594457] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.594560] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.594622] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.594969] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d17fda10-7148-4558-b429-6c6b75b5f20d',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.636721] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.636936] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.636985] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.637228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.638872] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.638970] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.640364] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.640507] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.641191] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.641284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.641981] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.642088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.643044] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.643044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.663948] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.664122] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad9e53d9-a7e1-4764-bc44-f35fa2308feb is going to be deleted. [ 1297.665207] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.665409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.687711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.687941] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0212d5d1-3785-49e1-b4e8-aaad4f538d18 is going to be deleted. [ 1297.688752] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.688968] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.712133] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.712315] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c61af5d-d112-491b-97cd-9e037a2e5189 is going to be deleted. [ 1297.713184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.713405] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.719603] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.719825] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.734733] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.734928] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be29eb73-d99e-4af1-ad2e-c5ce871f7807 is going to be deleted. [ 1297.735865] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.736136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.748535] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.748722] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.756750] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.756909] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59c26ae1-e2ae-453d-a285-e702cf89832f is going to be deleted. [ 1297.757907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.758149] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.793018] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.793273] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.797935] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.797935] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.800373] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.800494] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0f8a62e-96a1-4434-a694-20df67619d3c is going to be deleted. [ 1297.801394] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.801607] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.801700] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.801820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad9e53d9-a7e1-4764-bc44-f35fa2308feb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.801972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.802148] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.802230] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.802347] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0212d5d1-3785-49e1-b4e8-aaad4f538d18" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.802858] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.803039] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.803128] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.803247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c61af5d-d112-491b-97cd-9e037a2e5189" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.803377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.803524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.803601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.803711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be29eb73-d99e-4af1-ad2e-c5ce871f7807" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.875616] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.875836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.875836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.876066] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.876192] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.876315] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59c26ae1-e2ae-453d-a285-e702cf89832f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.918545] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.918755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.918755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.918956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.919069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.919199] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0f8a62e-96a1-4434-a694-20df67619d3c" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.096128] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29e1de56-440c-4328-94fb-d8f682a71bad taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.096355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.096404] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.096614] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.096843] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.096972] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.097051] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.097221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.097309] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.097399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.097513] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29e1de56-440c-4328-94fb-d8f682a71bad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.101215] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.101355] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.101424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.101601] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.101784] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.101883] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.101943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.102097] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.102178] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.102260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.102343] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.107957] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.108120] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.108120] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.108391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.108623] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.108775] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.108874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.109109] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.109247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.109386] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.109521] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.145712] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.145920] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.145920] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.146202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.148567] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.148567] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.149553] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.149694] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.150587] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.150725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.151664] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.151795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.153607] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.153698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.154775] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.154904] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.155886] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.156042] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.157045] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.157188] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.158228] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.158360] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.159460] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.159593] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.170734] env[65102]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1298.171254] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.171408] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd79c243-92bc-47a2-80ad-114091c4bab9 is going to be deleted. [ 1298.172331] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.172534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.191939] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.192166] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a03dedcf-91ec-46f5-b008-cad3f9c1d50b is going to be deleted. [ 1298.192989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.193232] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.210416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.210583] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e4d0983-93de-4906-b7b5-69591bafe0fd is going to be deleted. [ 1298.211521] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.211772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.233869] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.234093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.236527] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.236700] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 642eb2e5-acd8-44f5-87bb-521553cbd5e2 is going to be deleted. [ 1298.237851] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.238578] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.240127] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.240282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.288527] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.288726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.309147] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.309450] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4374bed5-fea3-4dd3-b7b5-66b0f19f6284 is going to be deleted. [ 1298.310692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.311038] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.368839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.369024] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43c26daa-d251-465e-af14-279e7838d2a3 is going to be deleted. [ 1298.369882] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.370123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.394656] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.394906] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.397377] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.397532] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a0c01bc-dc67-4824-bf8b-60c7f41f292f is going to be deleted. [ 1298.398508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.398761] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.446782] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.447069] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.448598] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.448786] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 085dab98-e474-491b-84c3-9542fcfa6775 is going to be deleted. [ 1298.449902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.450169] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.461433] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.461633] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.496730] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.496929] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0807565d-e6cc-4e93-b299-cd44c8892eaa is going to be deleted. [ 1298.497836] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.498077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.575772] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.576185] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d17fda10-7148-4558-b429-6c6b75b5f20d is going to be deleted. [ 1298.576992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.577260] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.578736] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.578848] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.579475] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.579570] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.601729] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29e1de56-440c-4328-94fb-d8f682a71bad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.607777] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.610326] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.610326] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4501856-910f-4bf4-9fd2-4d3675738a94 is going to be deleted. [ 1298.611139] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.611351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.611451] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.611574] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd79c243-92bc-47a2-80ad-114091c4bab9" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.612347] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.612540] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.612628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.612762] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a03dedcf-91ec-46f5-b008-cad3f9c1d50b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.613294] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.613471] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.613556] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.613675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e4d0983-93de-4906-b7b5-69591bafe0fd" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.614437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.614692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.614874] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.615010] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-642eb2e5-acd8-44f5-87bb-521553cbd5e2" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.615231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.615386] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.615494] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.615634] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4374bed5-fea3-4dd3-b7b5-66b0f19f6284" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.615840] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.616957] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.617135] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.617259] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.617424] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43c26daa-d251-465e-af14-279e7838d2a3" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.617756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.617907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.617988] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.618116] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a0c01bc-dc67-4824-bf8b-60c7f41f292f" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.618249] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.618393] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.618469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.618575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-085dab98-e474-491b-84c3-9542fcfa6775" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.622822] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.622981] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.623272] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.623469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.623563] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.623686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0807565d-e6cc-4e93-b299-cd44c8892eaa" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.730893] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.731231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.731231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.731549] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.731711] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.731938] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d17fda10-7148-4558-b429-6c6b75b5f20d" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.743179] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.743496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.743496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.743755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.743904] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.744067] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4501856-910f-4bf4-9fd2-4d3675738a94" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.104326] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29e1de56-440c-4328-94fb-d8f682a71bad: rpc.has_security_group_logging(os_id): False [ 1299.110267] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9b36c7e-229d-48ea-b61f-94b35a51b7f4: rpc.has_security_group_logging(os_id): False [ 1299.118977] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29d98990-b866-4c6c-b1d9-41effdf1076b: rpc.has_security_group_logging(os_id): False [ 1299.125457] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.125725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.125725] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.125885] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.130849] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.131095] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.137432] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.137692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.147969] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.148395] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.148520] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.148569] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.148859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.148991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.149156] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29e1de56-440c-4328-94fb-d8f682a71bad is going to be updated. [ 1299.150297] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.150528] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.170316] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.170631] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.170740] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.170784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.170990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.171087] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.171178] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 is going to be updated. [ 1299.172304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.172497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.192818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.193224] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.193371] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.193436] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.193672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.193789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.193889] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b is going to be updated. [ 1299.227102] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.227102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.227102] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.227432] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.227473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.241894] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29e1de56-440c-4328-94fb-d8f682a71bad in Status: IN_PROGRESS for 2s [ 1299.252550] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.252712] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.252799] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.253021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.253325] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.255692] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.255862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.255862] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.256073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.256211] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.287691] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: IN_PROGRESS for 2s [ 1299.294612] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: IN_PROGRESS for 2s [ 1301.255379] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29e1de56-440c-4328-94fb-d8f682a71bad in Status: SUCCESS [ 1301.255699] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.302701] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: SUCCESS [ 1301.302955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.305708] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: SUCCESS [ 1301.305890] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.571662] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1302.571910] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1307.573207] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1307.573578] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1312.574280] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1312.574660] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1317.575805] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1317.576245] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1319.483728] env[65102]: INFO networking_nsxv3.common.synchronization [req-94279f25-cca8-4acc-bb3f-b88df856a1dc req-7abf9bd0-d2a3-4642-a4e9-ff96e00839e5 tempest-AttachVolumeTestJSON-843685348 tempest-AttachVolumeTestJSON-843685348-project-member] Enqueued Resource ID: 29e1de56-440c-4328-94fb-d8f682a71bad with Priority: HIGHEST for action security_group_members [ 1319.484295] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29e1de56-440c-4328-94fb-d8f682a71bad with Priority: HIGHEST for action security_group_members [ 1319.484602] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29e1de56-440c-4328-94fb-d8f682a71bad taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.484723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.484790] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.485537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.485537] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.485537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.485537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.485537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.485889] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.485889] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29e1de56-440c-4328-94fb-d8f682a71bad',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.989450] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.989675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.989729] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.990166] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.990166] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.990307] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.990307] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.990416] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.990489] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.990573] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.990653] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29e1de56-440c-4328-94fb-d8f682a71bad is going to be updated. [ 1320.017761] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.017990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.017990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.018222] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.018428] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.026896] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29e1de56-440c-4328-94fb-d8f682a71bad in Status: IN_PROGRESS for 2s [ 1322.038243] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29e1de56-440c-4328-94fb-d8f682a71bad in Status: SUCCESS [ 1322.038648] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29e1de56-440c-4328-94fb-d8f682a71bad deletion is rescheduled due to dependency. [ 1322.038648] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29e1de56-440c-4328-94fb-d8f682a71bad" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.191986] env[65102]: INFO networking_nsxv3.common.synchronization [None req-456fb17b-24d1-4803-ba7f-df1757c429cc tempest-AttachVolumeTestJSON-843685348 tempest-AttachVolumeTestJSON-843685348-project-member] Enqueued Resource ID: 331d1a64-e95c-453c-8a3e-77e776438b58 with Priority: HIGHEST for action security_group_rules [ 1324.192603] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331d1a64-e95c-453c-8a3e-77e776438b58 with Priority: HIGHEST for action security_group_rules [ 1324.192946] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-331d1a64-e95c-453c-8a3e-77e776438b58 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.193119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.193234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.193631] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.193781] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('331d1a64-e95c-453c-8a3e-77e776438b58',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.271256] env[65102]: INFO networking_nsxv3.common.synchronization [None req-2bf01dd2-1bf7-4faf-b7a5-2a3b508d2c81 tempest-AttachVolumeTestJSON-843685348 tempest-AttachVolumeTestJSON-843685348-project-member] Enqueued Resource ID: 331d1a64-e95c-453c-8a3e-77e776438b58 with Priority: HIGHEST for action security_group_rules [ 1324.272036] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331d1a64-e95c-453c-8a3e-77e776438b58 with Priority: HIGHEST for action security_group_rules [ 1324.272380] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-331d1a64-e95c-453c-8a3e-77e776438b58 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.272488] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.715457] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.715735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.715735] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.715947] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.716055] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.716153] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 331d1a64-e95c-453c-8a3e-77e776438b58 already deleted. [ 1324.716237] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.716388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.716572] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.716658] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('331d1a64-e95c-453c-8a3e-77e776438b58',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.236729] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.237200] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.237200] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.237200] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.237351] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.237351] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 331d1a64-e95c-453c-8a3e-77e776438b58 already deleted. [ 1325.237442] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.272693] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1329.273128] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.687541] env[65102]: INFO networking_nsxv3.common.synchronization [req-fdbd2d37-4379-4c1c-8c3a-26d0348e8530 req-6e62cb47-10d7-4c20-b5fd-86f0b8b46a05 tempest-AttachVolumeTestJSON-843685348 tempest-AttachVolumeTestJSON-843685348-project-member] Enqueued Resource ID: 331d1a64-e95c-453c-8a3e-77e776438b58 with Priority: HIGHEST for action security_group_members [ 1329.687541] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331d1a64-e95c-453c-8a3e-77e776438b58 with Priority: HIGHEST for action security_group_members [ 1329.687541] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-331d1a64-e95c-453c-8a3e-77e776438b58 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.687541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.687541] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.687809] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.687809] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.687934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.687934] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.688056] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.688145] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.688238] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331d1a64-e95c-453c-8a3e-77e776438b58',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.001968] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.002214] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-367" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.002337] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-367" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.002608] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-367" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.002879] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.003041] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.003157] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.003380] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.003523] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.003732] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1330.003845] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1330.003953] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1330.004072] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1330.004183] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1330.004295] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1330.004447] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1330.025410] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1330.025653] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1330.025794] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1330.025943] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-367" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.026277] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-a900303a-2f4a-4b1f-b115-37e160d3834a taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.026449] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-a900303a-2f4a-4b1f-b115-37e160d3834a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.026670] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-a900303a-2f4a-4b1f-b115-37e160d3834a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.026991] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-a900303a-2f4a-4b1f-b115-37e160d3834a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.027150] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a900303a-2f4a-4b1f-b115-37e160d3834a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.190383] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.190597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.190597] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.190808] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.190902] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.191108] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.191214] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.191269] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.191419] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.191486] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.191574] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331d1a64-e95c-453c-8a3e-77e776438b58 already deleted. [ 1330.191680] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.529453] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.529871] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.529871] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.530246] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.530432] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.530596] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port a900303a-2f4a-4b1f-b115-37e160d3834a not found, creating... [ 1330.530926] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.531112] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.531233] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.531459] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.531619] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.531971] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.532211] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.532388] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.532622] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.532755] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.532922] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: a900303a-2f4a-4b1f-b115-37e160d3834a is going to be created. [ 1330.553831] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.554064] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.554197] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.554871] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.555141] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.555360] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-a900303a-2f4a-4b1f-b115-37e160d3834a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.253628] env[65102]: INFO networking_nsxv3.common.synchronization [req-fdbd2d37-4379-4c1c-8c3a-26d0348e8530 req-f11035ab-bd43-4520-a32c-e5296fafa130 service nova] Enqueued Resource ID: 331d1a64-e95c-453c-8a3e-77e776438b58 with Priority: HIGHEST for action security_group_rules [ 1331.253838] env[65102]: INFO networking_nsxv3.common.synchronization [req-fdbd2d37-4379-4c1c-8c3a-26d0348e8530 req-f11035ab-bd43-4520-a32c-e5296fafa130 service nova] Enqueued Resource ID: 331d1a64-e95c-453c-8a3e-77e776438b58 with Priority: HIGHEST for action security_group_members [ 1331.254009] env[65102]: INFO networking_nsxv3.common.synchronization [req-fdbd2d37-4379-4c1c-8c3a-26d0348e8530 req-f11035ab-bd43-4520-a32c-e5296fafa130 service nova] Enqueued Resource ID: a900303a-2f4a-4b1f-b115-37e160d3834a with Priority: HIGHEST for action port [ 1331.254511] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331d1a64-e95c-453c-8a3e-77e776438b58 with Priority: HIGHEST for action security_group_rules [ 1331.254647] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331d1a64-e95c-453c-8a3e-77e776438b58 with Priority: HIGHEST for action security_group_members [ 1331.254746] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a900303a-2f4a-4b1f-b115-37e160d3834a with Priority: HIGHEST for action port [ 1331.255164] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-331d1a64-e95c-453c-8a3e-77e776438b58 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.255319] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.255409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.255635] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.255728] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('331d1a64-e95c-453c-8a3e-77e776438b58',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.256997] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-331d1a64-e95c-453c-8a3e-77e776438b58 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.257234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.257370] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.257508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.257667] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.257769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.257830] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.257971] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.258110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.258170] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331d1a64-e95c-453c-8a3e-77e776438b58',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.259226] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-a900303a-2f4a-4b1f-b115-37e160d3834a taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.259642] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a900303a-2f4a-4b1f-b115-37e160d3834a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.259760] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a900303a-2f4a-4b1f-b115-37e160d3834a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.259943] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a900303a-2f4a-4b1f-b115-37e160d3834a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.260033] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a900303a-2f4a-4b1f-b115-37e160d3834a',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.757794] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-331d1a64-e95c-453c-8a3e-77e776438b58 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.758253] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.760227] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('331d1a64-e95c-453c-8a3e-77e776438b58',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.761643] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a900303a-2f4a-4b1f-b115-37e160d3834a with status ACTIVE [ 1331.761829] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.762239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.762239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.762239] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.762378] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.762506] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.762605] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.762668] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.762813] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.762896] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.763081] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.763184] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.763230] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.763364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.763437] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.763522] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a900303a-2f4a-4b1f-b115-37e160d3834a is going to be updated. [ 1331.783821] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.784033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.784033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.784220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.784353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.784508] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a900303a-2f4a-4b1f-b115-37e160d3834a" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.262101] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('331d1a64-e95c-453c-8a3e-77e776438b58',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.765495] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.766130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.766130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.766130] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.766362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.766429] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331d1a64-e95c-453c-8a3e-77e776438b58 is going to be created. [ 1332.790848] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.791110] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.791166] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.791341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.791502] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.800199] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331d1a64-e95c-453c-8a3e-77e776438b58 in Status: UNINITIALIZED for 2s [ 1334.811434] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331d1a64-e95c-453c-8a3e-77e776438b58 in Status: SUCCESS [ 1334.811793] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.811842] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.812085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.812232] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.812350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.812523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.812561] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.812641] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.812726] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.812821] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('331d1a64-e95c-453c-8a3e-77e776438b58',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.315407] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('331d1a64-e95c-453c-8a3e-77e776438b58',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.817822] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 331d1a64-e95c-453c-8a3e-77e776438b58: rpc.has_security_group_logging(os_id): False [ 1335.836341] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.836497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.836558] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.836795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.836891] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.837153] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.837258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.837317] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.837482] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.837555] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.837643] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 331d1a64-e95c-453c-8a3e-77e776438b58 is going to be created. [ 1335.900065] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.900291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.900291] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.900469] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.900655] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.914009] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 331d1a64-e95c-453c-8a3e-77e776438b58 in Status: IN_PROGRESS for 2s [ 1336.255509] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1336.255769] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1337.928351] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 331d1a64-e95c-453c-8a3e-77e776438b58 in Status: SUCCESS [ 1337.928776] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.256824] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1341.257294] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1341.922272] env[65102]: INFO networking_nsxv3.common.synchronization [req-231fd39a-4833-4e38-9fd0-aa681ab36ed1 req-cc1737a4-e028-49e4-9ece-7222cab6bfbd tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_members [ 1341.922702] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_members [ 1341.923024] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.923151] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.923218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.923418] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.923579] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.923678] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.923752] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.923907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.923995] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.924100] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.426244] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.928865] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.028995] env[65102]: INFO networking_nsxv3.common.synchronization [req-12d603c1-cc7d-4402-bb93-8c28598ab4c5 req-b1565630-6d4e-43bb-8063-f2f9f9bd9350 tempest-ServerActionsTestJSON-273915797 tempest-ServerActionsTestJSON-273915797-project-member] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 1343.029576] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 1343.030387] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.030533] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.030604] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.030847] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.030961] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.031081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.031146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.031312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.031397] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.031492] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.431387] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.431769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.431769] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.431895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.431992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.432131] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 is going to be updated. [ 1343.460721] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.460956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.460956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.461159] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.461312] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.472626] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: IN_PROGRESS for 2s [ 1343.533458] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.533672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.533672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.533824] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.533918] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.534130] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.534327] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.534392] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.534546] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.534625] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.534726] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b is going to be updated. [ 1343.561762] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.562025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.562025] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.562218] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.562369] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.570736] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: IN_PROGRESS for 2s [ 1345.482363] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: SUCCESS [ 1345.482790] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.580632] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: SUCCESS [ 1345.580819] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b deletion is rescheduled due to dependency. [ 1345.580868] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.030398] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.030818] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1351.167744] env[65102]: INFO networking_nsxv3.common.synchronization [req-57f214f9-a196-48f3-8bb7-fe97dad5156c req-86e508d2-51c2-495e-bb6b-1a6fcfc305aa tempest-ServerActionsTestJSON-273915797 tempest-ServerActionsTestJSON-273915797-project-member] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 1351.170188] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 1351.170490] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.170621] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.170689] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.170879] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.171047] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.171183] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.171258] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.171398] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.171530] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.171601] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.462308] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.462398] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.462483] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.462757] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.463026] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.463191] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.463308] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.463521] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.463664] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.463917] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1351.464236] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1351.464382] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1351.464497] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1351.464611] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1351.464717] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1351.464848] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1351.485610] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1351.485796] env[65102]: DEBUG dogpile.cache.region [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1351.485893] env[65102]: DEBUG dogpile.lock [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1351.486182] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "network-599" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.486548] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock port-187b4d9a-9a89-4e19-8674-5bd91faf1d78 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.486727] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "port-187b4d9a-9a89-4e19-8674-5bd91faf1d78" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.486878] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "port-187b4d9a-9a89-4e19-8674-5bd91faf1d78" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.487271] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "port-187b4d9a-9a89-4e19-8674-5bd91faf1d78" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.487415] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('187b4d9a-9a89-4e19-8674-5bd91faf1d78',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.673549] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.673783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.673783] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.674061] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.674157] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.674359] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.674461] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.674524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.674686] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.674759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.674849] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b is going to be updated. [ 1351.700282] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.700525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.700525] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.700696] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.700839] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.710214] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: IN_PROGRESS for 2s [ 1351.989768] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.990033] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.990172] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.990493] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.990581] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.990737] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Segment Port 187b4d9a-9a89-4e19-8674-5bd91faf1d78 not found, creating... [ 1351.990998] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.991179] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.991297] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.991514] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.991652] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.991929] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.992095] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.992216] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.992422] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.992557] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.992695] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Resource: SegmentPort with ID: 187b4d9a-9a89-4e19-8674-5bd91faf1d78 is going to be created. [ 1352.018946] env[65102]: DEBUG networking_nsxv3.common.locking [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.019208] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.019331] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.019603] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.019834] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.020069] env[65102]: DEBUG oslo_concurrency.lockutils [None req-81b6bc7b-f7fd-4e7d-a0f7-a3ac73f15c66 None None] Releasing lock "port-187b4d9a-9a89-4e19-8674-5bd91faf1d78" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.714606] env[65102]: INFO networking_nsxv3.common.synchronization [req-57f214f9-a196-48f3-8bb7-fe97dad5156c req-fbcc134f-f053-402a-bf8e-0e06ad0cc543 service nova] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_rules [ 1352.714859] env[65102]: INFO networking_nsxv3.common.synchronization [req-57f214f9-a196-48f3-8bb7-fe97dad5156c req-fbcc134f-f053-402a-bf8e-0e06ad0cc543 service nova] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 1352.714859] env[65102]: INFO networking_nsxv3.common.synchronization [req-57f214f9-a196-48f3-8bb7-fe97dad5156c req-fbcc134f-f053-402a-bf8e-0e06ad0cc543 service nova] Enqueued Resource ID: 187b4d9a-9a89-4e19-8674-5bd91faf1d78 with Priority: HIGHEST for action port [ 1352.715274] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_rules [ 1352.715412] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 1352.715513] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187b4d9a-9a89-4e19-8674-5bd91faf1d78 with Priority: HIGHEST for action port [ 1352.715786] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.715908] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.716081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.716911] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.717093] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.717968] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.718088] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.718302] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-187b4d9a-9a89-4e19-8674-5bd91faf1d78 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.718399] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-187b4d9a-9a89-4e19-8674-5bd91faf1d78" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.718477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-187b4d9a-9a89-4e19-8674-5bd91faf1d78" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.719209] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-187b4d9a-9a89-4e19-8674-5bd91faf1d78" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.719209] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('187b4d9a-9a89-4e19-8674-5bd91faf1d78',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.220113] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.220375] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.220427] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 187b4d9a-9a89-4e19-8674-5bd91faf1d78 with status ACTIVE [ 1353.220619] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.220708] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.220796] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.220989] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.221136] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.221282] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.221380] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.221447] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.221596] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.221692] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.221851] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.221956] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.222021] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.222154] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.222234] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.222364] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 187b4d9a-9a89-4e19-8674-5bd91faf1d78 is going to be updated. [ 1353.246356] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.246600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.246600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.246751] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.246919] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.247073] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-187b4d9a-9a89-4e19-8674-5bd91faf1d78" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.720287] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: SUCCESS [ 1353.720600] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b deletion is rescheduled due to dependency. [ 1353.720600] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.720747] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.720962] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.721164] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.721284] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.721350] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.721504] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.721586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.721682] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.223795] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.725827] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.228531] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.228745] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.228818] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.228997] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.229093] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.229199] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b is going to be updated. [ 1355.259652] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.259848] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.259944] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.260220] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.260405] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.270084] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: IN_PROGRESS for 2s [ 1357.280552] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: SUCCESS [ 1357.280929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.280929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.281241] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.281449] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.281568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.281638] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.281826] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.281914] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.281959] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.282137] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.716404] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1357.716602] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1357.784359] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.284578] env[65102]: INFO networking_nsxv3.common.synchronization [req-a6c6c3d6-1163-4064-8a58-c2a2c2cc3772 req-c0baf188-fccd-4798-983d-bce30cac1628 tempest-ServerActionsTestOtherA-567098223 tempest-ServerActionsTestOtherA-567098223-project-member] Enqueued Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_members [ 1358.285398] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 with Priority: HIGHEST for action security_group_members [ 1358.285520] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.285784] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.285873] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.286736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.286736] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.286736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.286736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.286736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.286736] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.287043] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b36c7e-229d-48ea-b61f-94b35a51b7f4',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.288637] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 29d98990-b866-4c6c-b1d9-41effdf1076b: rpc.has_security_group_logging(os_id): False [ 1358.311695] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.311837] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.311907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.312127] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.312224] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.312501] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.312609] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.312675] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.312834] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.312912] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.313006] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b is going to be updated. [ 1358.377435] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.377435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.377435] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.377821] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.378033] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.393245] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: IN_PROGRESS for 2s [ 1358.789227] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.789227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.789227] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.789517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.789517] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.789701] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.789795] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.789873] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.790044] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.790125] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.790203] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 is going to be updated. [ 1358.823431] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.823702] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.823702] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.824026] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.824150] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.834276] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: IN_PROGRESS for 2s [ 1360.408318] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: SUCCESS [ 1360.408628] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.844959] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 in Status: SUCCESS [ 1360.845250] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b36c7e-229d-48ea-b61f-94b35a51b7f4 deletion is rescheduled due to dependency. [ 1360.845405] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b36c7e-229d-48ea-b61f-94b35a51b7f4" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.286178] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.286608] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1368.287319] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.287774] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1373.289097] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.289530] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1378.290852] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1378.290852] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1383.292538] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.292928] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1388.294076] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1388.294417] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.294935] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.295478] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.296455] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.296756] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1403.298061] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.298569] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.229259] env[65102]: INFO networking_nsxv3.common.synchronization [req-5412add6-94ab-4c02-a60a-145f18e94707 req-40123acf-57fd-4478-800b-0c1367afeb5a tempest-AttachVolumeTestJSON-843685348 tempest-AttachVolumeTestJSON-843685348-project-member] Enqueued Resource ID: 331d1a64-e95c-453c-8a3e-77e776438b58 with Priority: HIGHEST for action security_group_members [ 1405.229557] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 331d1a64-e95c-453c-8a3e-77e776438b58 with Priority: HIGHEST for action security_group_members [ 1405.229740] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-331d1a64-e95c-453c-8a3e-77e776438b58 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.229928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.229928] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.230282] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.230455] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.230568] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.230612] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.230768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.230855] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.230949] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('331d1a64-e95c-453c-8a3e-77e776438b58',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.732897] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.733236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.733236] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.733364] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.733405] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.733639] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.733768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.733768] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.733901] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.733978] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.734078] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331d1a64-e95c-453c-8a3e-77e776438b58 is going to be updated. [ 1405.762904] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.763163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.763163] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.763353] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.763504] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.778509] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331d1a64-e95c-453c-8a3e-77e776438b58 in Status: IN_PROGRESS for 2s [ 1407.790203] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 331d1a64-e95c-453c-8a3e-77e776438b58 in Status: SUCCESS [ 1407.790616] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 331d1a64-e95c-453c-8a3e-77e776438b58 deletion is rescheduled due to dependency. [ 1407.790616] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-331d1a64-e95c-453c-8a3e-77e776438b58" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.230895] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.231314] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1414.527220] env[65102]: INFO networking_nsxv3.common.synchronization [req-d6eb15f2-7c47-4a21-aa01-d27def0f58cd req-9cc5d40a-168f-4620-8e63-98e6c256199f tempest-ServerActionsTestJSON-273915797 tempest-ServerActionsTestJSON-273915797-project-member] Enqueued Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 1414.527796] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29d98990-b866-4c6c-b1d9-41effdf1076b with Priority: HIGHEST for action security_group_members [ 1414.528115] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-29d98990-b866-4c6c-b1d9-41effdf1076b taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.528240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.528308] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.528504] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.528755] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.528755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.528882] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.528984] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.529037] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.529129] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('29d98990-b866-4c6c-b1d9-41effdf1076b',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.032081] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.032081] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.032383] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.032383] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.032453] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.032743] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.032886] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.032955] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.033142] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.033226] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.033308] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b is going to be updated. [ 1415.061153] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.061388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.061388] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.061580] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.061723] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.070019] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: IN_PROGRESS for 2s [ 1417.081203] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 29d98990-b866-4c6c-b1d9-41effdf1076b in Status: SUCCESS [ 1417.081603] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 29d98990-b866-4c6c-b1d9-41effdf1076b deletion is rescheduled due to dependency. [ 1417.081603] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-29d98990-b866-4c6c-b1d9-41effdf1076b" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.528496] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1419.528962] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1422.600184] env[65102]: INFO networking_nsxv3.common.synchronization [None req-715ba620-b506-4bc3-8472-66bc525f6be0 None None] Enqueued Resource ID: 0de00d75-3f1b-45fd-a9b0-193c9722d908 with Priority: HIGHEST for action port [ 1422.600722] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0de00d75-3f1b-45fd-a9b0-193c9722d908 with Priority: HIGHEST for action port [ 1422.601045] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-0de00d75-3f1b-45fd-a9b0-193c9722d908 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.601175] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0de00d75-3f1b-45fd-a9b0-193c9722d908" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.601240] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0de00d75-3f1b-45fd-a9b0-193c9722d908" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.601497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0de00d75-3f1b-45fd-a9b0-193c9722d908" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.601599] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0de00d75-3f1b-45fd-a9b0-193c9722d908',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.104292] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0de00d75-3f1b-45fd-a9b0-193c9722d908 [ 1423.104519] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.104658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.104751] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.104966] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.105100] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.105251] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0de00d75-3f1b-45fd-a9b0-193c9722d908 already deleted. [ 1423.105348] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0de00d75-3f1b-45fd-a9b0-193c9722d908" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.761183] env[65102]: INFO networking_nsxv3.common.synchronization [None req-3565f3c9-f50e-4c80-80e9-242792e83f8d None None] Enqueued Resource ID: 86a65769-6324-4589-a915-28fa18409aed with Priority: HIGHEST for action port [ 1424.761475] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86a65769-6324-4589-a915-28fa18409aed with Priority: HIGHEST for action port [ 1424.762146] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-86a65769-6324-4589-a915-28fa18409aed taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.762146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86a65769-6324-4589-a915-28fa18409aed" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.762146] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86a65769-6324-4589-a915-28fa18409aed" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.762739] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86a65769-6324-4589-a915-28fa18409aed" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.762739] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86a65769-6324-4589-a915-28fa18409aed',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1425.264670] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86a65769-6324-4589-a915-28fa18409aed [ 1425.264858] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1425.264992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1425.264992] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1425.265256] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1425.265358] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.265456] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86a65769-6324-4589-a915-28fa18409aed already deleted. [ 1425.265551] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86a65769-6324-4589-a915-28fa18409aed" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.918041] env[65102]: INFO networking_nsxv3.common.synchronization [req-9381967d-571b-44c4-905b-cc3c7d6bc155 req-aa6c25a8-be30-4d9b-85f9-23d397167138 tempest-ServerAddressesTestJSON-2115740622 tempest-ServerAddressesTestJSON-2115740622-project-member] Enqueued Resource ID: 19bce2dc-9dec-40a6-a405-7032602559a1 with Priority: HIGHEST for action security_group_members [ 1427.918343] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19bce2dc-9dec-40a6-a405-7032602559a1 with Priority: HIGHEST for action security_group_members [ 1427.918650] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-19bce2dc-9dec-40a6-a405-7032602559a1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.918778] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.918859] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.919257] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.919425] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1427.919534] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1427.919658] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1427.919756] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1427.919844] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1427.919938] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19bce2dc-9dec-40a6-a405-7032602559a1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.200607] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.200797] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "network-686" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.200924] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "network-686" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.201274] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "network-686" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.201535] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.201691] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.201808] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.202126] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.202335] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.202549] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1428.202662] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] NeedRegenerationException {{(pid=65102) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1428.202772] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] no value, waiting for create lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1428.202880] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] value creation lock acquired {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1428.202987] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] No value present for key: 'zone-id' {{(pid=65102) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1428.203106] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Calling creation function for not-yet-present value {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1428.203235] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1428.226175] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1428.226380] env[65102]: DEBUG dogpile.cache.region [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65102) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1428.226457] env[65102]: DEBUG dogpile.lock [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Released creation lock {{(pid=65102) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1428.226632] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "network-686" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.226943] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock port-3161afbe-814d-44e0-8611-720927ba01eb taken with stack trace [, , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.227127] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "port-3161afbe-814d-44e0-8611-720927ba01eb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.227246] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "port-3161afbe-814d-44e0-8611-720927ba01eb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.227593] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "port-3161afbe-814d-44e0-8611-720927ba01eb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.227729] env[65102]: DEBUG networking_nsxv3.api.rpc [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3161afbe-814d-44e0-8611-720927ba01eb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1428.422494] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.422672] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.422763] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.422983] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.423091] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.423286] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.423375] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.424040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.424040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.424040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.424040] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19bce2dc-9dec-40a6-a405-7032602559a1 already deleted. [ 1428.424040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.730452] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.730696] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.730814] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.731120] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.731275] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.731433] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Segment Port 3161afbe-814d-44e0-8611-720927ba01eb not found, creating... [ 1428.731699] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.731860] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.732007] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.732250] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.732388] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.732678] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.732835] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.732994] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.733180] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.733311] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.733451] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Resource: SegmentPort with ID: 3161afbe-814d-44e0-8611-720927ba01eb is going to be created. [ 1428.753399] env[65102]: DEBUG networking_nsxv3.common.locking [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1428.753626] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1428.753720] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1428.753988] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1428.754243] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.754468] env[65102]: DEBUG oslo_concurrency.lockutils [None req-198c00fa-17e5-48c7-bee3-dffed5038d8e None None] Releasing lock "port-3161afbe-814d-44e0-8611-720927ba01eb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.451101] env[65102]: INFO networking_nsxv3.common.synchronization [req-9381967d-571b-44c4-905b-cc3c7d6bc155 req-576a0c51-c51a-468f-b19f-fb8a5589660a service nova] Enqueued Resource ID: 19bce2dc-9dec-40a6-a405-7032602559a1 with Priority: HIGHEST for action security_group_rules [ 1429.451349] env[65102]: INFO networking_nsxv3.common.synchronization [req-9381967d-571b-44c4-905b-cc3c7d6bc155 req-576a0c51-c51a-468f-b19f-fb8a5589660a service nova] Enqueued Resource ID: 19bce2dc-9dec-40a6-a405-7032602559a1 with Priority: HIGHEST for action security_group_members [ 1429.451472] env[65102]: INFO networking_nsxv3.common.synchronization [req-9381967d-571b-44c4-905b-cc3c7d6bc155 req-576a0c51-c51a-468f-b19f-fb8a5589660a service nova] Enqueued Resource ID: 3161afbe-814d-44e0-8611-720927ba01eb with Priority: HIGHEST for action port [ 1429.452290] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19bce2dc-9dec-40a6-a405-7032602559a1 with Priority: HIGHEST for action security_group_rules [ 1429.452474] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19bce2dc-9dec-40a6-a405-7032602559a1 with Priority: HIGHEST for action security_group_members [ 1429.452582] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3161afbe-814d-44e0-8611-720927ba01eb with Priority: HIGHEST for action port [ 1429.452865] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19bce2dc-9dec-40a6-a405-7032602559a1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.452990] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.453072] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.453333] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.453418] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19bce2dc-9dec-40a6-a405-7032602559a1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.454293] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-19bce2dc-9dec-40a6-a405-7032602559a1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.454409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.454477] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.454649] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.454799] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.454897] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.454961] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.455119] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.455202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.455293] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19bce2dc-9dec-40a6-a405-7032602559a1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.456556] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock port-3161afbe-814d-44e0-8611-720927ba01eb taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.456713] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3161afbe-814d-44e0-8611-720927ba01eb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.456786] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3161afbe-814d-44e0-8611-720927ba01eb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.458463] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3161afbe-814d-44e0-8611-720927ba01eb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.458463] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3161afbe-814d-44e0-8611-720927ba01eb',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.959073] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19bce2dc-9dec-40a6-a405-7032602559a1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1429.960250] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-19bce2dc-9dec-40a6-a405-7032602559a1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.960362] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.960520] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3161afbe-814d-44e0-8611-720927ba01eb with status ACTIVE [ 1429.960680] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.960787] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.960853] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.961077] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.961171] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.961346] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.961443] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.961506] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.961667] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.961744] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.962616] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.962728] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.962789] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.963158] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.963247] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.963339] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3161afbe-814d-44e0-8611-720927ba01eb is going to be updated. [ 1429.985954] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1429.986221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1429.986221] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1429.986386] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1429.986524] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.986679] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3161afbe-814d-44e0-8611-720927ba01eb" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.465959] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19bce2dc-9dec-40a6-a405-7032602559a1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.968672] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.968949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.968949] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.969190] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.969283] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.969385] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19bce2dc-9dec-40a6-a405-7032602559a1 is going to be created. [ 1430.995281] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.995496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.995496] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.995696] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.995894] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.004978] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19bce2dc-9dec-40a6-a405-7032602559a1 in Status: UNINITIALIZED for 2s [ 1433.016647] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19bce2dc-9dec-40a6-a405-7032602559a1 in Status: SUCCESS [ 1433.017058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.017058] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.017267] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.017465] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.017599] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.017650] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.017797] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.017878] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.017991] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.018103] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19bce2dc-9dec-40a6-a405-7032602559a1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1433.520563] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-19bce2dc-9dec-40a6-a405-7032602559a1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.520806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.520806] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.520994] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.521174] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.521276] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.521341] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.521497] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.521586] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.521673] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.521816] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-19bce2dc-9dec-40a6-a405-7032602559a1 taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.521907] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.522016] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.522123] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.522259] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1433.522349] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1433.522409] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1433.522544] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1433.522619] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.522698] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1433.522786] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19bce2dc-9dec-40a6-a405-7032602559a1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1434.025478] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19bce2dc-9dec-40a6-a405-7032602559a1: rpc.has_security_group_logging(os_id): False [ 1434.043999] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.044181] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.044265] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.044481] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.044575] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.044788] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.044887] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.044950] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.045122] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.045202] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.045389] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.045483] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.045549] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.045683] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.045759] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.045974] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.046086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.046086] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.046231] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.046304] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.046391] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19bce2dc-9dec-40a6-a405-7032602559a1 is going to be created. [ 1434.108231] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.108473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.108473] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.108653] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.108838] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.120316] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19bce2dc-9dec-40a6-a405-7032602559a1 in Status: IN_PROGRESS for 2s [ 1434.454435] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1434.454435] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1436.134364] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19bce2dc-9dec-40a6-a405-7032602559a1 in Status: SUCCESS [ 1436.134765] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.931593] env[65102]: INFO networking_nsxv3.common.synchronization [req-98cca2d6-8141-4552-afee-c2430cd89ce9 req-31fa7343-c7b8-40c9-802c-8544e7c90c62 tempest-ServerAddressesTestJSON-2115740622 tempest-ServerAddressesTestJSON-2115740622-project-member] Enqueued Resource ID: 19bce2dc-9dec-40a6-a405-7032602559a1 with Priority: HIGHEST for action security_group_members [ 1437.932138] env[65102]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19bce2dc-9dec-40a6-a405-7032602559a1 with Priority: HIGHEST for action security_group_members [ 1437.932469] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock member-19bce2dc-9dec-40a6-a405-7032602559a1 taken with stack trace [, , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.932780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.932780] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.932929] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.933145] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.933201] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.933243] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.933391] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.933491] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.933598] env[65102]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19bce2dc-9dec-40a6-a405-7032602559a1',) {} {{(pid=65102) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1438.435950] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.436228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.436228] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.436427] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.436523] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.436723] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.436820] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.436884] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.438085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.438085] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.438085] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19bce2dc-9dec-40a6-a405-7032602559a1 is going to be updated. [ 1438.468346] env[65102]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65102) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.468537] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.468583] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.468755] env[65102]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.468895] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.476909] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19bce2dc-9dec-40a6-a405-7032602559a1 in Status: IN_PROGRESS for 2s [ 1440.488621] env[65102]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19bce2dc-9dec-40a6-a405-7032602559a1 in Status: SUCCESS [ 1440.489040] env[65102]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19bce2dc-9dec-40a6-a405-7032602559a1 deletion is rescheduled due to dependency. [ 1440.489040] env[65102]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19bce2dc-9dec-40a6-a405-7032602559a1" {{(pid=65102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.933256] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1442.933620] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1447.934715] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1447.935128] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1452.936469] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1452.936904] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1457.937263] env[65102]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1457.937643] env[65102]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0